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Introduction to the Practice Guide on Effective Advising for 


Postsecondary Students 


Students enter postsecondary institutions to 
change their lives in some way, with degree 
pursuits providing opportunities to grow 
academically, socially, and professionally. 
However, significant numbers of students 

are unable to meet the goals they had set for 
themselves when they entered college. About 
AO percent of undergraduate students at 

4-year institutions had not graduated 6 years 
after starting their program, as reported by 

the National Center for Education Statistics.' 
Similarly, 41 percent of students at 2-year degree- 
granting institutions either had not graduated or 
were not enrolled in another institution 3 years 
after starting their program.” 


College students 


face challenges that, | See the Glossary for 
if unaddressed, a full list of key terms 
can lead them to used in this guide and 


their definitions. These 
terms are underlined 
when first introduced 
in the guide. 


drop out of their 
postsecondary 
institution. 
These challenges 
include social, 
informational, and academic obstacles to 

college completion stemming from the 

demands of college life inside and outside of 

the classroom, misalignment between high 
school and college academic expectations, and 

a general lack of guidance and information.? 
Though postsecondary institutions might offer 
supports that could help students navigate these 
challenges, students are often unaware of these 
supports or might have difficulty accessing them 
because the supports are either limited or offered 
at inconvenient times or locations. 


At its most effective, advising is a collaborative 
process between a student and an advisor 
designed to help the student realize their 
educational potential. Most postsecondary 


institutions have historically used advisors to 
help students select and register for courses, 

but postsecondary institutions are increasingly 
asking advisors to play an instrumental role in 
helping students progress through college. This 
expanded advising role often involves ensuring 
students are connected to both academic 
supports and non-academic supports that enable 
students to overcome barriers to persistence 
and completion.‘ In this expanded role, advisors 
help students formulate personal, academic, 
and career goals; navigate college requirements 
and resources; develop study skills; make sound 
decisions about financing college; balance 
academic and non-academic obligations such as 
work or childcare; and overcome other social, 
emotional, or academic barriers they might face. 


Developed by the What Works 
Clearinghouse™ (WWC) in conjunction with 

an expert panel, this guide draws upon studies 
of effective postsecondary student advising 
systems and practices. The expert panel believes 
the impacts of advising are magnified when 
advising is integrated within a broader structure 
of holistic student support. Holistic student 
support provides all students with the types and 
intensities of information, services, and resources 
they need to identify, select, and progress on 
the best pathway to achieve their educational 
and career goals. Holistic student support meets 
students where they are developmentally, 
addresses their individual needs, leverages 

their strengths, and focuses on student learning 
and development. 


A holistic approach to student supports—where 
advisors and other support staff help the student 
make seamless and timely connections to the 
student-specific supports they need—is thought 
to be more effective than is the typical approach. 
The typical, non-holistic approach might offer 
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students a wide set of supports, but the supports 
are disconnected. Then students, too often, are 
expected to navigate the supports available to 
them on their own, which can result in their 
accessing supports haphazardly, if at all. The 
difference between colleges providing access to 
student supports holistically and non-holistically 
is illustrated by Figure I.1, which was developed 
by Achieving the Dream.°* 


When integrated within a holistic student support 
model, advising plays a central role in helping 
students navigate the complicated systems and 


Figure I.1. Typical vs. holistic student support 


Typical Student Support 
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experiences of college by connecting students 
to a wide range of supports and opportunities. 
Advisors often develop educationally purposeful 
relationships with students to engage, challenge, 
and support them as they plan their academic 
journey and to help them connect to academic 
and social supports in college. Under a holistic 
approach to supporting students, advisors’ 
guidance is meant to contribute to students’ 
persistence toward degree completion and help 
prepare them to transition into employment or 
further education. 


ACADEMIC 
SUPPORT 


CAREER 
PLANNING 
ANO 
SERVICES 


Source: Achieving the Dream (2020). 
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Advising is increasingly provided by trained and 
designated “academic advisors” (referred to as 
“counselors” in some states), though student 
support staff, faculty, and peers, among others, 
might also contribute to advising activities. 
Students often do not make distinctions among 
the formal titles or roles of the individuals 
advising them. Rather than the role or title, the 
panel believes that what matters is there be an 
individual, or a team of individuals, available to 
effectively guide and support students. 


Who Might Find This Guide Useful? 


The primary audience for this guide is staff 
members at community colleges, 4-year 
institutions, and other public or private 
technical colleges who are responsible for 
designing and/or delivering advising to students. 
This includes academic advisors, faculty 
advisors, deans, registrars, program directors, 
other administrators, and student support staff, 
such as counselors, mentors, coaches, and 
tutors. Institutional leaders, such as presidents 
and boards, can also use this guide to inform 
how they support the design and delivery of 
student advising. 


The recommendations in this guide will also be 
useful for local, state, and federal policymakers 
responsible for providing the funding that could 
shape postsecondary advising policies and 
practices. Funders and grant-makers might also 
find this guide to be helpful when considering 
whether the postsecondary programs and 
initiatives they support include robust, evidence- 
based approaches to student advising. 
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Finally, the guide summarizes the rigorous 
research evidence on best practices that support 
its recommendations, which could help identify 
knowledge gaps that researchers could address in 
the future. 


Using Evidence to Develop the 
Recommendations 


This practice guide adds to the existing 

body of literature on postsecondary student 
advising by synthesizing the evidence from 
group design studies to make four evidence- 
based recommendations for designing and 
delivering comprehensive, integrated advising 
to support students’ educational success. Each 
recommendation includes examples of advising 
strategies and how to implement them, advice 
on how to overcome potential obstacles, and a 
summary of the research evidence that supports 
the recommendation. 


The expert panel created a practice guide 
protocol to guide the evidence search and 
review.® Under that protocol, trained and WWC- 
certified reviewers summarized findings from 
eligible studies (see Box 1) that meet evidence 
standards for consideration by the panel.’ The 
number of studies identified, screened, and 
reviewed is summarized in Figure B.1 (see 
Appendix B). 
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Box 1. Study eligibility criteria 


Eligible research (1) used a comparison group 
design; (2) included an advising intervention 
with a primary focus on supporting students’ 
postsecondary success during or after 
college; (3) involved students enrolled in a 
postsecondary education institution in the 
United States or Canada; (4) was published 
in 1999 or later; and (5) reported on one or 
more outcomes in the following domains: 

(a) progressing in college, (b)academic 
achievement, (c) postsecondary degree, 

(d) credential attainment, and (e) post- 
graduation outcomes. 


After considering the evidence, the expert panel 
drafted the recommendations and assigned a 
level of evidence to each (see Box 2). 


The guide’s four recommendations and the 
panel’s strength-of-evidence assessment are 
shown in Table 1. Recommendations 1-3 focus 
on how to design or transform advising within a 


holistic student support model. Recommendation 


4 focuses on how to engage and sustain student 
involvement in advising. 
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Box 2. Levels of evidence 


Minimal: Evidence may not meet 

WWC standards or may exhibit 
inconsistencies, but the panel determined 
that the recommendation must be included 
because the intervention is based on strong 
theory, is new and has not yet been studied, 
or is difficult to study with a rigorous 
research design. 


Moderate: There is some evidence meeting 
WWC standards that the practices improve 
student outcomes, but there may be 
ambiguity about whether that improvement 
is the direct result of the practices or whether 
the findings can be replicated with a diverse 
population of students. 


Strong: There is consistent evidence that 
meets WWC standards and indicates that the 
practices improve student outcomes for a 
diverse population of students. 


Table 1. Recommendations and corresponding levels of evidence 


Practice Recommendation 


WV) Wo) im =AYA(0(-dalex=: 


Minimal Moderate Strong 


1. Intentionally design and deliver comprehensive, integrated advising 
that incorporates academic and non-academic supports to empower e 


students to reach their educational goals. 


2. Transform advising to focus on the development of sustained, 
personalized relationships with individual students throughout their  ) 


college career. 


3. Use mentoring and coaching to enhance comprehensive, integrated 
advising in ways that support students’ achievement and progression. 


4. Embed positive incentives in intentionally designed advising structures 


to encourage student participation and continued engagement. 
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Throughout the practice guide, the authors 
refer to the specific interventions that were 
examined in the 21 studies that meet WWC 
standards and provide the evidence for this 
practice guide (see Table 2). Readers can refer 
back to this table to be reminded of some of a 
study’s details.* Recommendation 1 is supported 
by eight studies, Recommendation 2 by 10 
studies, Recommendation 3 by 12 studies, and 
Recommendation 4 by six studies. The number 
of student participants in the studies ranged 
from 60 to 13,555. Eleven of the studies took 
place at 4-year institutions, eight took place at 
2-year institutions, and two took place at both 
2- and 4-year institutions. The majority of these 
studies were conducted at broad-access 4-year 
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institutions and community colleges. However, 
the panel believes the recommendations are 
also relevant for other institutions because 

all institutions serve students who need—and 
would benefit from—an advisor who can provide 
personalized, intentional advising and connect 
them to other academic and non-academic 
supports to maximize the likelihood that they 
achieve their postsecondary goals. 


Though the studies included in this practice 
guide meet WWC standards and informed the 
evidence-based recommendations in this practice 
guide, it is important for readers to know that 
the authors do not endorse any interventions or 
programs featured in the studies. 


Table 2. Overview of Studies Providing Evidence to this Practice Guide 


#of Institution 


Intervention Study Students | Type 1 2 } |! 

Adelante Scholarship Program Patel & Valenzuela (2013) 1,028 2-year e e e 

Accelerated Study in Associate Scrivener et al. (2015) 896 | 2-year e e e 

Programs (ASAP) at CUNY 

Accelerated Study in Associate Miller et al. (2020) 1,501 2-year e e e 

Programs (ASAP) in Ohio 

CUNY Start Scrivener et al. (2018) 3,835 2-year e 

Enhanced Integrated Planning Mayer et al. (2019) 8,011 2-year e e 

and Advising for Student Success 4-year 

(iPASS) 

Future Connect Hodara et al. (2017) 1,163 2-year e e 

InsideTrack Bettinger & Baker (2014) 13,555 2-year e e 

4-year 

Key Communities Nosaka & Novak (2014) 3,982 | 4-year e e e 

Mentoring Program (faculty) Campbell & Campbell (2007) 678 4-year e 

Mentoring Program (peer) Servies (1999) 60 | 4-year e 

Mentoring Program (peer) Dennehy & Dasgupta (2017) 150 4-year e 

Mentoring Program for African Thomas (2005) 80 4-year e 

American Students (peer) | 

Mentoring Program (peer) Kim et al. (2013) 76 4-year e 

Mentoring & Coaching Lavallais (2017) 100 | 4-year e 

Meyerhoff Scholars Program Maton et al. (2000) 155 4-year e e e 

Online Goal-Setting and Coaching Oreopoulos & Petronijevic 2,990 4-year e 
(2018)? 
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Hop lineutagen 
Intervention Study Students | Type 4 2 Ea 


Opening Doors Brock & Richburg-Hayes 1,019 2-year e 
(2006) 

Opening Doors Scrivener & Weiss (2009) 2,139 2-year e e 

Student Support Services (SSS) Sundy (2017) 140 2-year e 

Summer Bridge Program Medina (2016) 7,770 4-year e 

Vision Inspired Scholarship through Binder et al. (2015) 1,081 4-year e e 

Academic Achievement (VISTA) 


Overarching Themes 


Each recommendation focuses on a particular 
aspect of designing and delivering advising 

to postsecondary students. Though these 
evidence-based recommendations are the 
focus of this practice guide, we highlight four 
overarching themes that cut across multiple of 
its recommendations. These themes, which are 
based on the panelists’ judgment and experience, 
could provide general guidance and context 
for readers to consider as they engage with 

the recommendations. 


¢ Institutions must be intentional about 
the purpose and goals of advising, and 
recognize that achieving these goals can 
require institutions to change some of 
their systems and practices. Institutions 
could ask, “What are the student-focused 
outcomes we are trying to achieve through 
advising?” The answer to this question must 
resonate with an institution’s priorities and 
academic mission as well as with the range of 
challenges faced by the student population 
being served. 


Adopting or adapting new approaches to 
postsecondary student advising can be 

both time and resource intensive. Whether 
institutions are just starting to revise their 
advising approach, are gradually enhancing 
their advising strategies, or recently 
overhauled their entire approach to advising, 
there is always room for improvement. 


Intentionally designing advising programs 
to be comprehensive and integrated could 
require investment by the institution. The 
expert panel believes it is important that 
institutions make and sustain a commitment 
to holistic student support that meets 

the varied needs of their students from 
enrollment to graduation, and that the 
institution continually search for new ways to 
purposefully integrate advising services into 
students’ college experience. 


In some institutions, rising resource 
constraints could make it hard to enact all of 
the recommendations in this guide. These 
institutions might need to make strategic 
finance choices or re-assess funding priorities 
in order to fully implement the needed 
student supports. They also might assess 
whether there are structural changes that 
could be made to better deploy the staff who 
are currently available on campus in ways that 
could provide all students with the level of 
advising that they need to be successful. This 
guide provides advice on how to get the most 
out of the resources available. 


Advisors’ roles can be expanded beyond 
supporting student registration. Advisors 
should be seen as responsible for more than 
simply helping large numbers of students 
register for courses. Instead, they need 

to develop relationships with students, in 
order to help students progress and grow 
throughout their college journey. Then if 
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advisors are expected to develop sustained, 
in-depth relationships with individual 
students, institutions might need to consider 
changing their advising model by, for example, 
reducing or shifting advisors’ caseloads. 


Given the diversity of student 
characteristics and needs, there is no one- 
size-fits-all advising model. All students, 
regardless of background, are likely to face 
academic or non-academic challenges—or 
both—while in college. Institutions must 

be responsive and adaptable. They can be 
proactive in their efforts to better serve 
students by systematically addressing three 
questions: (1) What do our students need? (2) 
When do they need it? and (3) How will we 
deliver those supports to students? 


Knowing institutions have finite resources, 
the expert panel recognizes institutions must 
also account for their own context when they 
consider which students or groups of students 
need added supports or services to reach 
their potential. They include students who are 
enrolled in developmental education courses, 
who are enrolled in majors that do not have 
high completion rates, who are first-generation 
college students, or who are historically 
underserved. It is important for institutions 

to keep questions of equity in mind as they 
identify when it is appropriate 

to offer all students a particular advising 
support, as opposed to only a particular 
group of students. 


Technology is best used to facilitate and 
enhance advising, not to replace advisors. 
Technology has and continues to play a role in 
advising, but technology is not a silver bullet. 
Instead, technology can be used to improve 
advising by making it more efficient to receive, 
share, and act upon information about student 
progress. An institution’s initial investment in 
technology could pay off when advisors are 
able to use real-time data and tools to identify 
student needs and connect them to academic 
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and non-academic supports that promote their 
progress and success in college. These tools 
could be especially relevant with the increases 
of remote teaching and learning. 


How to Use This Practice Guide 


For each of its four recommendations, this guide 
includes the following: 


The recommendation: Details about 

the recommended practice, example 

advising strategies and practices, the 
recommendation’s level of evidence, anda 
description of how the recommended practice 
supports student outcomes. Appendix C 
contains a detailed rationale for the level- 
of-evidence category assigned to each 
recommendation (minimal, moderate, or 
strong) and information on the individual 
studies that support it. Each recommendation 
also includes one or more sidebar “Highlights 
From the Field” that provide implementation 
details from one of the supporting studies. 


“How to Carry Out the Recommendation” 
section: Guidance on how to implement 

the recommended practice. This guidance 

is informed by the studies that support the 
recommendation as well as by the expert 
panel’s expertise and knowledge of resources 
and strategies available to help implement 
the recommendation." Though multiple steps 
to carrying out the recommendation are 
offered, not every step will be appropriate to 
every institution, nor is every step required to 
implement a recommendation successfully. 


“Potential Obstacles and the Panel’s 
Advice” section: Advice from the expert 
panel about design and implementation 
challenges and how to overcome them. 


Tools and Resources: Examples related 
to the guidance for how to carry out the 
recommendation are provided throughout 
in figures. 


WWC 2022003 


Effective Advising for Postsecondary Students | Introduction | 7 


The expert panel intends for the 
recommendations in this guide to be treated 
as a coherent set of evidence-based advice that 
postsecondary institutions can consider when 
planning and implementing student advising 
activities. Some interventions discussed in 

this guide continue to be implemented but 
others may have been discontinued. Because 
the guide is about practices and not brand- 
name interventions, studies of interventions 
implemented in the past may still be valid and 
useful to inform practices implemented today. 
Users of this guide are encouraged to apply the 
advice provided here in ways that fit best into 
the varied contexts in which they are delivering 
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advising to postsecondary students. For example, 
institutions will need to consider resource 
constraints as they think about which advising 
strategies to adopt and the capacity of their staff 
to deliver those strategies in the desired dosage 
and for the desired duration. Depending on their 
unique institutional context, individual users 

of this guide might decide to prioritize some 

of the panel’s recommendations over others. 
Though this guide does not provide step-by-step 
instructions for implementation, readers will find 
resources mentioned throughout providing more 
information and guidance about how to apply a 
particular practice. 
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Recommendation 1: Intentionally design and deliver comprehensive, 


integrated advising that incorporates academic and non-academic 
supports to empower students to reach their educational goals. 


Introduction 


Advising is not always viewed as a mission-central 
function of postsecondary institutions. For 
advising to be most effective in helping students 
successfully advance in their educational 
pathways, it should be intentionally integrated 
within a holistic student support structure that 
offers supports to address both academic and 
non-academic barriers that students face.” 
Comprehensive, integrated advising refers 

to advising that is intentionally designed to 
connect students with a broad range of relevant 
academic and non-academic supports. Through 
the relationships they build, advisors play a key 
role in understanding the needs of individual 
students. With that understanding, advisors can 
help connect students to appropriate supports 
so they are better able to navigate complicated 
academic, financial, social, and emotional 
challenges and reach their educational goals. 


Comprehensive academic and non-academic 
student supports included in the studies for 
this recommendation could be in the form of 
advising, counseling, tutoring and instructional 
support, peer and faculty mentoring, financial 
advising and support, and personal and career 
coaching, among others.” Comprehensive 
supports are often provided by a broad range 
of offices, advisors, student support staff, and 
faculty across campus. 


To facilitate collaboration, it is important to 
clearly articulate the roles and responsibilities 
of the offices and staff delivering each student 
support." It is equally important to ensure 
students are aware of the supports available to 
them, and that they know how to access the 
supports. Institutions should monitor students’ 


engagement with available academic and non- 
academic supports and consider ways to improve 
supports or make them more available and 
appealing to students, if needed. 


WWC staff and the expert panel assigned 
Recommendation 1 a moderate level of evidence, 
based on eight studies of comprehensive, 
integrated advising interventions implemented 
with postsecondary students in the United 
States. Four of the studies'* meet WWC group 
design standards without reservations, and the 
other four studies” meet WWC group design 
standards with reservations. The interventions 
demonstrated statistically significant and 
positive average effects on progressing in college, 
academic achievement, and postsecondary 
degree attainment (see Table 3). Evidence 

from the eight studies provides a direct test 

of the recommendation, as the interventions 
deliver advising that is part of or connected 

to a comprehensive support structure in four 
different ways: 


¢ Offering academic supports, such as tutoring, 
developmental or supplemental education, 
college success courses, or academic 
workshops (eight studies); 


¢ Extending financial supports for tuition, such 
as scholarships, tuition waivers, or financial 
aid (five studies); 


¢ Providing other financial supports, such as 
transportation assistance, emergency funds, 
or free textbooks (two studies); and 


¢ Hosting community-building activities, such as 
social events and community service projects 
(three studies). 
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Table 3. Results of Meta-analysis for Recommendation 1 


Average Effect of Comprehensive and Integrated Advising 


Statistically Statistically 
Yrefaliicer-lalar-lale| Sle fatniter-talar- ale} 
Outcome Domain positive Indeterminate negative 
Progressing in college @ 
Academic achievement td 


Postsecondary degree 


attainment . 


attainment or post-graduation outcomes domains. 


The panel has a high degree of confidence in 
the research suggesting that comprehensive 

and integrated advising is an effective practice. 
Recommendation 1 was not assigned a 

strong level of evidence because effects are 
predominantly derived from studies that 

meet WWC group design standards with 
reservations. See Appendix C for a detailed 
rationale for the level of evidence assignment 
for Recommendation 1, including descriptions of 
the intervention features and findings from each 
study informing this recommendation. 


How to Carry Out the 
Recommendation 


This section describes strategies, examples, and 
tools that can support the intentional design and 
delivery of comprehensive, integrated advising 
at postsecondary institutions. All figures and 
mentions of specific colleges or interventions 

in Recommendation 1 are offered as examples 
only and should not be read as endorsements of 
specific products or approaches. 


1. Situate advising as a core function in 
alignment with the mission and goals of 
the institution. 


The panel recommends that advising be 
situated as a core function of the institution. 
Advising should aim to improve students’ 


Note: No studies that meet WWC standards and are relevant to this recommendation included findings in either the credential 


connectedness with the college community, 
develop self-directed learners who engage 

in their learning process, and connect 
students with the supports they need to 
overcome barriers to persistence and degree 
completion.'* One way of achieving this is 

by ensuring that advisors and other student 
support staff have shared student-focused 
goals that align with the mission of the college. 
This entails that the goal of advising reaches 
beyond helping students register for courses, 
and that advising is seen as a function that 
supports student learning. 


For advising to truly be a core function of 

the college, it needs to be integrated within 

a broader structure of student supports. 
Relatedly, advising leadership should 
continually coordinate with other offices and 
staff that provide student supports throughout 
the design and implementation of student 
support programs and initiatives. The panel 
suggests advising leadership should participate 
in planning committees, student and academic 
affairs meetings, and other groups that make 
decisions on the college’s mission and goals, 
staffing, and budgetary priorities. 


The Ohio Accelerated Study in Associate 
Programs (ASAP) Replication Demonstration 
offers an example of facilitating collaboration 
across offices and staff that provide student 


WWC 2022003 


Effective Advising for Postsecondary Students | Recommendation 1 | 10 


supports through the creation of planning 
committees. The planning committees 
included administrators and staff members 
from the colleges’ academic affairs and 
student services departments, and they 
played an important role in designing and 
launching programs on each campus. The 
planning committees and other staff members 
identified match funding, identified or hired 
staff, secured office space, and worked to put 
each program component into operation.” 


Tools and resources, such as the National 
Academic Advising Association (NACADA)’s 
Factors to Consider When (Re)Structuring 
Academic Advising (Figure 1.1), can help 
institutions take stock of their current advising 
practices as they work to integrate advising 
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into the broader system of supports available 
to students. Figure 1.1 describes factors 

to consider when restructuring academic 
advising that will enable the institution to 
better understand the supports provided— 
from current status and need for advising 
services to how they will be delivered, the 
role of the advisor, and how to fund any 
new approaches to advising. Administrators, 
advisors, and other student support staff 
can use the list of factors—or a select set of 
these—to structure their conversation during 
the planning stage of redesigning advising at 
their college. Further, these tools can ensure 
that advisors are well positioned to connect 
students to the supports they need.” 
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Figure 1.1. Factors to consider when (re)structuring academic advising 


1. 


13. 


14. 


15. 


16. 


17. 


Status and Need. What is the current status of academic advising on your campus? What student (and institutional) 
needs are met by the current system? What needs are not being met? How do you know? Start with the NACADA 
Core Competencies, NACADA Core Values, the Conditions of Excellence in Academic Advising and the CAS 
Standards for Academic Advising. 


Mission, Vision, and Philosophy of Academic Advising. How does the institution articulate the role and importance 
of academic advising? Is there a formal and written advising philosophy easily accessible by all constituents? Is there 
an advising mission statement? Is there a vision statement to serve as a guide to the future of advising? Are the 
academic leaders and decision-makers committed to long-term support through strategic planning? 


Equity, Inclusion, and Diversity. How do you facilitate “individual and institutional conversations that promote 
understanding, respect, and honor diverse perspectives, ideas, and identities” (NACADA, 2021)? 


Learning. What does the institution want to accomplish as a result of the advising program? What should students 
be able to know, do, and value through the academic advising experience? What strategies (pedagogies, curricula, 
workshops, assessments, etc.) need to be implemented to meet these goals, objectives, and intended outcomes? 


Is the advising system intentionally structured? Who will advise and who will oversee and lead advising 
strategies, goals, and objectives? Will you utilize professional (primary role) advisors? Peer advisors? Faculty 
advisors? If you choose faculty, should all faculty advise, or should advisors be selected based on desired 
characteristics and/or willingness to serve? 


How will advising be delivered? What advising models will be used to structure the delivery of advising? Will 
students be advised in person by a faculty member from their office? Will there be an Advising Center? Where can 
students find support if their assigned advisors are not available? Will students need an appointment for advising? Will 
students have access to both synchronous and asynchronous modes of delivery for advising-related interactions? 
Will group advising be utilized? 


Is advising supported through integrated technologies? What are the information needs for students and 
advisors? How can you ensure that both students and advisors have the information they need when they need it while 
maintaining confidentiality? Is the technology appropriate and accessible to support their learning? Is there training and 
support for both advisors and advisees to support the technology being utilized? 


Advisor/Advisee Responsibilities. Are there stated expectations for advisors/advisees? I|s there an advising 
syllabus that is explicitly provided to students? Is there on-going professional development for advisors? Is there an 
updated academic advisor handbook or does one need to be developed or revised? 


Student Participation. Should all students be required to see an advisor? If not, what criteria will you use to determine 
who must be advised? How ‘intrusive’ or ‘proactive’ should your advising program be? What messages are 
automatically sent to students and how effective are they in encouraging a response? 


Advisor Caseload. What is a reasonable advisor to student ratio for your institution’s advising situation that is based on 
explicit expectations and responsibilities for the role? 


Assignment of students. What criteria will be employed to assign students to advisors? Will students be assigned 
alphabetically? based on major? based on their year in school? 


Developing Advisors’ Skills and Knowledge. What are the training and professional developmental needs of advisors 
and how might these best be addressed in a systematic and scaffolded program that is grounded in related higher 
education literature? 


Assessment and Evaluation. How will you assess and evaluate the effectiveness of your advising program? What 
are your intended program outcomes? What do you expect students to learn, do, and/or value because they were 
advised? How will you know if your efforts are successful? What tools will you use, and what evidence is appropriate? 
How often will you conduct an assessment cycle? 


Recognition/rewards. How can you provide a tangible, meaningful, and realistic reward system to advisors (both 
primary-role advisors and faculty advisors)? Do you have a career ladder in place to encourage continuity and stability 
in the advising core, and to acknowledge their role as professional educators? 


Integration. What are the relationships between academic advising and campus resources? Do advisors know when, 
and how, to refer students to these resources? 


Funding. What are the fiscal requirements of the advising program? Are monies available to adequately meet 
these needs? 


Implementation. What must be done, and who should be involved, in the implementation of the desired academic 
advising program? 


Source: Miller et al. (2021). 
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2. Determine what supports students need 


and whether there are gaps and overlaps 
in the supports currently available. 


A useful starting point for designing and 
delivering comprehensive, integrated advising 
is to develop an understanding of the types 

of supports students need. Institutions could 
consider what academic, financial, social, 

and emotional challenges students might 


Figure 1.2. Sample template for assessing student needs 
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face during their college experience. The 
template in Figure 1.2 includes questions 
about financial circumstances and background 
characteristics that can help an advising team 
begin evaluating the extent of student need on 
campus.” Initial assessments such as this one 
can help institutions identify and anticipate 
the student needs that their comprehensive 
supports must address. The panel suggests 


Student Needs Assessment 


cial Circumstances 
. What percentage of students work more than 20 
hours a week? 


. What percentage of working students experience 
regular changes in their shifts or number of hours? 


. What percentage of students receive or are eligible 
for Pell Grants? 


_ Of those who receive Pell Grants, what percentage 
live below the poverty threshold for a family of four? 


. What percentage of students say they live paycheck 


to paycheck? 


. What percentage of students receive income-based — 


public assistance? 


. What percentage of students feel they are carrying 
too much debt? 


. What percentage of students struggle to feed 
themselves and/or their families? 


. What percentage of students have unstable living 
situations? 


. What percentage of students have children or care 
for family or friends? — 


. What percentage of students have a disability 
or other health concern for which they may want 
assistance? 


. What percentage of your students come from 
households where English is not their first language? 


. What percentage of students come from households 
where no one has a college degree? 


. What percentage of students are being flagged for 
additional services? 


. What percentage of students come to your campus 
knowing what career they are seeking? 


Source: Achieving the Dream (2018). 
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that the assessment can be tailored to and 
completed for different student groups, as the 
identified needs could differ across these. 


See Recommendation 2 for additional 
information about how to determine the 
characteristics and needs of the students. 


Beyond a student needs assessment, the panel 
also recommends that institutions identify any 
gaps and overlaps in the supports currently 
available to students as they progress through 
college—from initial orientation through 
degree completion. One strategy that can be 
used for this purpose is process mapping, 
which involves both staff and students at an 
institution documenting the processes and 
requirements students must complete as they 
progress toward graduation. After mapping the 
intended processes and requirements, both 
staff and students can share their experiences 
regarding successes and challenges students 
encounter when navigating the processes, 

as well as potential gaps and overlaps in the 
supports that are currently available to 

assist students. 


To earn a credential, students need to 
successfully navigate a wide range of university 
processes, from selecting a major to filing 

an application for graduation. The panel 
recommends that institutions identify the 
most significant processes students interact 
with during their journey, including processes 
that students could encounter when they are 
“off-track” (e.g., appealing a course grade). 
Next, institutions should detail how students 
experience each process and then identify 
specific supports that the institution might 
offer to increase the likelihood that students 
navigate processes successfully. 


Providing students with a broad range of 
supports and establishing connections across 
them requires more than just referrals, 
policies, and procedures. Moreover, it is 
important to have a partnership and structure 
in place when sending a student to another 
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department for support. There should be 
communication between departments, as 

a team approach to advising and support 
services can help ensure that students do not 
feel as though they are just another number 
standing on line in a different office. The panel 
believes strongly that advisors should provide 
a “warm handoff” by introducing the student 
to their colleague in another office. To do that 
requires student support staff who know how 
other offices that provide support operate 
(see also Recommendation 2 on sustained, 
personalized advisor-student relationships). 


Design comprehensive advising to 
meet the individual needs of a diverse 
student population. 


To support diverse student populations and 
the varying needs of individual students, 
colleges should provide a broad range of 
academic and non-academic supports that 
are deliberately selected and connected to 
meet individual students’ needs.” The panel 
recommends that available student supports 
be delivered in a way that is intentional and 
guided by an advisor who has a sustained, 
personalized relationship with the student (see 
Recommendation 2). The role of the advisor 
is to understand the needs of individual 
students and connect them with relevant 
supports, where these supports might be 
provided either directly by the advisor or by 
other departments on campus. 


As part of the Opening Doors Demonstration at 
Owens Community College and Lorain County 
Community College, students had access to 
designated counselors and a broad range 

of student support staff. Needs addressed 

by these staff included course scheduling, 
registration, financial aid and other financial 
issues, tutoring, work-based learning efforts, 
juggling school and work, career aspirations, 
and personal issues. One of the part-time 
counselors at Lorain had expertise as a career 
development specialist, and she met with 
many of the participating students to help 
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them explore career options and align their 
academic efforts with their employment 

goals. As part of their commitment to provide 
comprehensive supports, both colleges 
designated staff in the financial aid office to 
serve as special liaisons for Opening Doors 
students and provided other student supports, 
such as one-on-one tutoring.” 


The expert panel believes advising should meet 
students where they are by considering their 
needs and challenges and by being available 

to meet when and where students are.” Yet, 
the panel also recognizes that meeting the 
diverse needs of students could require a broad 
range of student supports. For example, the 
Adelante Scholarship Program, which targets 
low-income Hispanic male students, provided a 
wide range of support services to help 

students overcome academic, financial, and 
personal barriers to postsecondary success. 
Some supports were selected to provide 
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study skills and time management, whereas 
others were meant to provide students with 
resources and knowledge to help them 
navigate and succeed in a college environment. 
Additional supports were added to foster a 
sense of community and positive engagement 
between Adelante students and the college, 
the staff, and their peers.” 


The Accelerating Opportunity program, 

which provides Adult Basic Education and 
career and technical training combined 

with support services to underprepared 

and nontraditional students, illustrates an 
approach to comprehensive student supports 
(Figure 1.3). The figure provides a resource 
that administrators and advisors can use when 
thinking about the different types of student 
support for this particular student population, 
including their general purpose, and 
illustrative examples of the activities that could 
be involved under each type of support.”° 


students important academic tools, such as 


Highlights from the Field ’ 


Intentionally Designing and Delivering Comprehensive, Integrated Advising: Future Connect 


Future Connect is a long-term financial and advising support program that addresses multiple barriers to college access 
and achievement. The Future Connect scholarship is intended to cover the cost of tuition after applying other federal 
and state financial aid for up to three years at Portland Community College. The program also provides other financial 
resources, such as bus tickets and student access to an emergency fund (used on a case-by-case basis), as well as housing 
support for students in foster care. 


Future Connect developed a holistic advising model that provides relationship-based, student-centered advising, 
combined with a broad array of academic and non-academic supports to students. Future Connect begins with early 
outreach in high school to recruit students and build trust with students during the transition from high school to 
college. Each College Success Coach, who functions as a holistic advisor, works with a caseload of 70 to 120 students to 
help them reach their postsecondary and career goals. 


Coaches provide individualized advising and support, primarily in regular one-on-one meetings with students. Future 
Connect students enroll in two free college and career success courses taught by their coach (College Survival & Success; 
and Today’s Careers). Students also have access to optional leadership opportunities including a leadership course or 
internships. Students receive transfer support, including opportunities to apply for scholarships to attend Lewis & Clark 
College, Pacific University, Portland State University, among others. 


The College Success Coaches provide support early on that may be key to students’ early persistence. Specifically, they 
communicate the message that college is possible, and they provide early case management, social and emotional 
support, and assistance with financial aid. Coaches also build students’ trust and establish a personal relationship by 
being dependable, reliable, and caring; honoring confidentiality; sharing personal experiences; normalizing students’ 
experiences; and communicating clear expectations. 


(Hodara et al., 2017) 
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Figure 1.3. Examples of comprehensive supports for underprepared and nontraditional students 


¢ Purpose: To support students in pursuing and succeeding in their 


INN a es sills studies oe . . 
INDI Ne) * Activities: assessment of academic skill needs; meeting with academic 


advisors to review course selection; tutoring; supplemental coursework; 
access to online learning supports 


¢ Purpose: To foster students’ sense of connection to the college; enhance 
their self-confidence as members of the college community; and develop their 
Ne) \V:Xor-\ a) =") [(es ability to access college resources and make decisions that support their 
ADVISING success as students 


¢ Activities: college navigation advising; time management training; study 
skills development 


¢ Purpose: To identify student career goals; share relevant information about 
labor market conditions and career opportunities; ensure that students pursue 
coursework that facilitates achievement of their career goals; and support 
CAREER students in transitions into employment 


SERVICES 


¢ Activities: career interest assessment and goal setting; work-readiness 
courses; resume writing workshops; mock interviews; job shadowing/internship 
opportunities; job placement 


¢ Purpose: To support students in financing their postsecondary studies; 
to build students’ self efficacy in managing their resources for school and 


FINANCIAL personal needs 

SERVICES ¢ Activities: financial need assessment; identification of applicable financial 
aid resources; access to benefits; assistance with completion of financial aid 
applications; financial literacy workshops 


¢ Purpose: To assist students in managing their personal lives in order to 
[Yo lod Ves) = AN) (64 at support persistence in and completion of their studies 


& COUNSELING ¢ Activities: provision of or referral to child care resources, transportation 
assistance, housing assistance, or mental health counseling; life skills training 


Source: McDonnell, Soricone, & Sheen (2014). 


4. Clearly define the roles and staff.?* Given the potentially complex 
responsibilities of the different staff system of supports available to students, 
delivering student supports and ensure it is important to clearly articulate the 
close collaboration among those staff. roles and responsibilities of the staff and 


faculty delivering each academic and non- 
academic student support.” This will ensure 
that supports are provided efficiently and 
effectively, and that there is a college-wide 
coordination of who is responsible for 


Providing comprehensive advising involves 

a broad range of staff and faculty across 
campus.” These staff could include advisors, 
coaches, counselors, peer and faculty 
mentors, tutors, and other student support 
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delivering each support. As noted earlier, 
process mapping is one strategy that can be 
used to help institutions identify gaps and 
overlaps in the supports available to assist 
students in progressing toward graduation. As 
part of process mapping, staff can explicitly 
document the individual(s) responsible 

for supporting students along each step of 
their college journey. In doing so, the panel 
recommends staff should think intentionally 
about the best way for multiple individuals 
to support students in a coordinated, non- 
overwhelming way. Regardless of whether 
they create a process map of the student 
experience, institutions might consider the 
following questions as they consider student 
support roles and responsibilities: 


What supports are needed, and which are 
currently available? 


¢ What does “high-quality student support” 
look like in each varied support role 
on campus? 


e What supports do we currently offer? 
Why, when, and in what way are these 
supports offered? 


¢ Where are there gaps in supports? 


What resources are available to address 
gaps in supports? 


¢ Are we using all people on the campus 
efficiently to meet the needs of students at 
various times? 


e Which existing staff could be in a position 
to fill identified gaps? 


e Which gaps cannot be filled by existing 
resources, but remain a priority? 


e What kind of staff are needed to fill those 
priority gaps? 


*- How will these new staffing needs 
be funded? 
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¢- How can the process of engaging with 
different functions or support providers 
be streamlined for students? 


e How will we facilitate cross-role 
communication and coordination? 


« How can we promote familiarity and trust 
amongst staff? 


* How will we train and support staff to 
meet the expectations of their roles? 


¢ How will students know whom to go to 
and when? How will the advising structure 
be communicated to students? 


¢ Who serves the role of primary contact 
for a student who is facing academic 
challenges? What about for a student 
facing personal issues or challenges? 


¢ How will we evaluate the effectiveness or 
success of student supports? 


Members of a college’s leadership team 

are well positioned to take responsibility 

for establishing close collaboration and 
coordination between academic and non- 
academic student support services.*° For 
example, within the CUNY ASAP program, 
the CUNY Office of Academic Affairs 

ASAP leadership team works closely with 
participating colleges in their governance and 
delivery of the program and to assist colleges 
in their program’s operational and budgetary 
planning. The CUNY ASAP Academic Affairs 
team also plays a key role in promoting 
increased collaboration and resource sharing 
within and across institutions; for example, 
by working closely with the ASAP evaluation 
team to develop streamlined systems 

for data collecting and reporting across 
implementation sites.*! 


Collaboration and coordination can also 
be overseen by a program coordinator 
who conducts intentional outreach across 
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offices and departments. For example, the 
Adelante program coordinator worked 
closely with staff in financial aid, student 
accounts, student services, the learning 
centers, and various academic departments 
on campus to develop systems and processes 
that facilitated the implementation of the 
program. These included systems and 
processes for disbursing awards, tracking 
service utilization, and communicating with 
students. The program also required effective 
coordination among the learning centers, 
Adelante advisors, and counselors teaching 
academic workshops.” 


Clearly communicate the full range of 
student supports available to students. 


The panel believes information about who the 
student’s advisor is, the advisor’s role, and 
information on available supports needs to be 
communicated clearly to students—from first 
orientation to the final steps leading up to 
graduation. Institutions that have developed 
a process map of the student experience from 
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college enrollment to graduation could use 
the map as a basis for developing a visual that 
clearly lays out processes and requirements 
that students must complete, as well as how 
to access available supports along the way. 
The photos in Figure 1.4 are sample pathway 
maps created by college advisors and staff 
members who were trying to understand 
students’ experiences navigating campus 
requirements and supports. 


The panel suggests that new student 
orientation programs could afford a 

natural opportunity to begin addressing 
this recommendation. As part of its Key 
Communities program, which involves 
students in a learning community and peer 
mentoring to foster a sense of community, 
academics, leadership, diversity, and service, 
Colorado State University is intentional in 
making sure new students know about the 
support services available to them. Students 
begin with a special 2-day orientation prior 
to the start of the fall semester. The goal 

of the orientation as a whole is to foster a 


Source: Cal State Fullerton as a part of the CSU Student Success Network (left); Sierra College (right). 


WWC 2022003 


Effective Advising for Postsecondary Students | Recommendation 1 | 18 


sense of community; orient students to the 
expectations of the program; and acquaint 
students with peers, faculty, and student 
support staff. During the orientation, support 
staff provide information about how to access 
supports available on campus.” 


Beginning by getting to know students in 
the orientation activities, advisors then can 
play a key role in helping students navigate 
and connect with the supports they need 
throughout their college career.*‘ In the 
Future Connect program, College Success 
Coaches, who function as holistic advisors, 
use a variety of innovative strategies to ensure 
students are aware of resources available on 
campus. These strategies include leading 
campus tours, holding social events on 
campus, and building a resource scavenger 
hunt into the College Survival & Success 
curriculum so that students “are actually 
stepping into all those resources” through 
that process.** 


Continuously monitor student 
engagement with academic and non- 
academic supports. 


A central component of comprehensive, 
integrated advising is opportunities for 
students to engage with advisors and access 
relevant supports, as needed, throughout 
their time in college.*° Ongoing monitoring 
and evaluation of students’ engagement 
and experiences with advising will help 
the institution to continuously develop and 
improve its student supports.*’ Guiding 
questions for evaluating and monitoring 
students’ use of available supports include: 


* To what extent, if at all, are students using 
student support services? 


- Are there differences in usage across 
student groups? 


¢ What is the student’s experience with the 
different student support services offered? 
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¢ Are the supports easy to access and 
navigate? What, if any, challenges are 
students having as they navigate 
available supports? 


e Are additional staff or resources needed? 


Technology can be useful for monitoring 
how and the extent to which students are 
accessing student support services. CUNY 
ASAP, for example, created a tracking system 
for ASAP staff members to follow student 
participation in the program: contacts with 
advising and career services were logged 
in real time in the ASAP database, whereas 
tutoring visits and attendance in an ASAP 
seminar (now delivered as ASAP group 
advisement) were recorded weekly by 
college staff.** These data were tracked 
weekly for program management purposes 
and were reported to the CUNY Office of 
Academic Affairs each semester for 
evaluation purposes.*° 


Advisors can also use these tools to identify 
students requiring encouragement to 
participate in optional and mandatory 
support activities.*° To ensure consistent 
participation in advising, staff members in 
the Ohio ASAP Replication Demonstration 
used a variety of strategies—such as calls, text 
messages, and posts on course management 
systems-—to connect with students and 
remind them of upcoming appointments. The 
program directors and advisors in 

the program used the management 
information system for tracking student 
participation in the various program 
components (specifically, advising, 

tutoring, and career services) and 
completing monthly participation reports. 
Advisors from one college described how 
they routinely used the management 
information system to identify and follow 
up with students who had not fulfilled their 
required advising appointments.*! 
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Potential Obstacles and the 
Panel’s Advice 


OBSTACLE: Delivering comprehensive, integrated 
advising could require a significant and intentional 
transformation of how staff perform their roles. 


PANEL’S ADVICE: At many institutions, 
advisors guide students through course 
selection and registration but do not have the 
time, resources, or mandate to provide more 
comprehensive support to individual students. 
The panel recommends that institutions carry 
out an advising self-study, which can identify 
organizational opportunities and limitations for 
providing comprehensive, integrated advising. 
Such a self-study can help them determine how 
existing staff can be most effectively deployed 
and whether they need to hire or train additional 
staff to support advising. There are existing tools 
that can guide these types of self-studies. As part 
of its evaluation of the intervention Enhanced 
Integrated Planning and Advising for Student 
Success (iPASS), for example, the Community 
College Research Center developed an 
institutional self-assessment rubric for assessing 
existing advising and student support systems 

at postsecondary institutions. The assessment 
rubric is organized around institutional 
structures and processes, advising and student 
support leadership, vision and mission of 
advising, advising-related resources, and staff 
professional development, among other aspects 
of advising systems.” 


Recognizing the challenges that can accompany 
shifting away from a more typical advising 
model, the panel also recommends providing 
professional development for advisors so that 
they are better able to provide comprehensive 
advising to individual students. Training for 
advisors could include information on how best 
to develop sustained relationships with students. 
It also could include information on how to 
better function as a team with other service 
providers, so that advisors are better positioned 
to connect students with the variety of support 
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staff already working at the college. Training 
could also be provided to faculty mentors and 
other staff that are part of the student support 
structure, especially those from student affairs 
and academic affairs. In this way, the training can 
facilitate relationship building and serve to clarify 
roles and responsibilities. 


OBSTACLE: Providing comprehensive advising 
could require institutions to consider more creative 
and effective uses of current resources. 


PANEL’S ADVICE: The resources available at 

a given college can determine the availability 

of academic and non-academic supports. 
Institutions facing significant resource 
constraints might view investments in hiring 
more advisors, technology, and professional 
development as out of reach. Though these 

steps might pay off in the long run through 
increased student persistence and college 
completion, there are other options for providing 
comprehensive advising, even for institutions 
and advising departments with very limited 
resources. Many institutions could be able to 
provide more comprehensive advising by being 
creative about how to marshal existing resources. 


For example, the panel believes institutions 
should find ways to share responsibilities for 
improved advising across a wider range of staff 
members, such as identifying staff who are in 

less student focused roles and shifting them to 
take on advising responsibilities. This might be 

in the form of shifting responsibilities of non- 
professional staff toward roles and responsibilities 
that support advising, such as virtual front 

desks, initial triage of student needs, and helping 
prepare students for advising sessions. By 
reassigning some of the more administrative tasks 
to other staff, advisors can be freed up to provide 
more comprehensive advising that is tailored to 
individual student needs. 


Because students are not limited to developing 
supportive relationships with just their advisor, 
institutions might want to build in intentional 
opportunities for advisors to collaborate with 
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other staff assigned to support students. Many 
institutions already rely heavily on advisors 
directly connecting students to other campus 

or community resources.* The efficiency and 
effectiveness of these referrals can be enhanced 
when advisors and other support staff have 

a strong working knowledge of the available 
supports and they work in an integrated manner 
with the staff who provide those supports. 


If feasible, institutions might create “student 
success teams” that consist of multiple staff 
people assigned to support students through a 
case management-like approach. This structured 
team approach might incorporate staff from 
different departments on campus, and it has the 
potential to individualize supports in ways that 
help students feel more connected throughout 
their college experience. Saint Leo University, for 
example, uses a Student Success case manager/ 
coach approach, where a case manager connects 
students with services “by working closely 

with all university divisions and departments 

to identify and resolve systematic barriers that 
could affect retention and persistence.’** At 
Cosumnes River College, Student Success Teams, 
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comprising counselors, classroom faculty, peer 
mentors, and a dean, work together to provide 
student-centered holistic support.** 


The panel believes group advising can be a 
cost-effective way of covering general course 
selection, long-term course planning, and 
registration topics for groups of students. For 
example, at Saddleback College, advisors offered 
group counseling workshops four times a week. 
The 2-hour workshops, offered in addition to 
one-on-one advising, “were structured to ensure 
that students understood why and how to create 
an academic plan, could work on and complete 
their academic plan during the workshop, 

had access to counselors, and could leave the 
workshop as soon as their academic plan was 
reviewed and approved by the counselor.”** By 
offering support for basic academic planning in a 
group format, advisors at Saddleback were able 
to focus their advising sessions with individual 
students on more complex academic and non- 
academic challenges encountered by some of 
the students. Considerations for designing and 
delivering group advising are provided in 
Figure 1.5. 
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Figure 1.5. Considerations for designing and delivering group advising 


[C1 Decide if group advising is right for you. Some group advising will require more of a facilitator role, 
while other types will need more of an instructional approach. It is essential to decide if your advising style 
fits with group advising. For a group advising event to be successful, advisors need to give an honest 
assessment of their own personality to see if it fits with group advising (Ryan, 2010). 


O Decide if group or individual advising is appropriate for student(s). Advisors need to think about whether 
an individual or group advising approach would be more appropriate for their specific students. For example, 
an individual advising approach would be more appropriate when an advisor needs to 
discuss confidential information with the student. On the other hand, a group advising approach allows 
students to interact with each other to understand themselves better or listen to a presentation in a group 
where other students can support the understanding of the material through questions and comments. 


O Plan appropriately. Group advising requires planning in the following ways: locate a space that is 
functional for group advising; inform students of the session using multiple means of communication, 
such as e-mail, social media, and flyers; prepare engaging materials and handouts that students can take 
with them to refer to later (e.g., worksheets, curriculum guides, lists of important dates, and information 
on campus resources); and develop a clear agenda for the meeting (King, 2000). 


O Another item in planning for group advising is cost considerations. For example, advisors or advising 
administrators can do a cost-benefit analysis to determine the strengths and weaknesses of individual 
verse group advising sessions. A cost-saving analysis helps to determine the best approach to benefit 
the students while preserving savings for the university. Research showed in some cases group advising 
responds creatively and intentionally to the issue of budgetary constraints on college campuses 
(King, 2000; Ryan, 2010). 


O Be aware of strategies for successful group facilitation. |lcebreakers, introductions, and problem-based 
learning experiences are essential to establishing a climate in which students feel comfortable. Equally 
important, at the beginning of the group, it is helpful to discuss the broader purpose of advising as a 
means of assisting students in establishing appropriate and meaningful educational plans. 


0 Be familiar with campus resources to make appropriate referrals when necessary. Students attending 
group advising sessions may have some specific needs beyond the scope of the session. In these instances, 
it is essential that an advisor be well-connected on campus and understand campus resources to make 
appropriate referrals when necessary. 


O1 Evaluate student experiences with group advising. Assessment and evaluation certify that students are 
getting the most out of the sessions. In writing assessment questions, advisors need to create questions 
that evaluate the student’s experience in the group as well as assess the attainment of the learning 
outcomes for the group. If the questions for the assessment are written well, the evaluation results will 
be more relevant to advisors. 


Source: Johns & Wilson (2018). 


The panel also recommends that all institutions— to students who need them and can benefit 
whether facing resource constraints or not— the most. See Recommendation 2 and 
should be strategic about where to focus their Figure 2.6 for additional information about 
advising resources. Institutions might conserve identifying students who could be in need of 
resources by providing more intensive supports more intensive supports. 
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OBSTACLE: Accessing comprehensive student 
supports can be overwhelming for students. 


PANEL’S ADVICE: The broad range of support 
services can be overwhelming to some students, 
leaving them unsure how to access the student 
supports they need. The panel recommends 
that the purpose and roles of advisors, coaches, 
mentors, and other student support staff be 
clearly articulated to students. The panel 
believes that advisors play a key role in serving 
as the primary point persons students can go 

to when in doubt about how to access student 
supports. To the extent possible, supports should 
be communicated to students just in time. For 
example, providing students with information 
on what to do if you fail a midterm is far more 
effective if provided if and when the student fails 
a midterm than at a new student orientation. 
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To better communicate the role of the advisor 
and the various supports available, institutions 
might consider integrating advising into the 
college onboarding and first-year experiences. 
The panel also recommends, where feasible, 
introducing students to advising and student 
supports as part of academic activities, such 

as part of student success courses.” At Chaffey 
College, for example, the student success courses 
were taught by advisors and combined with 
instructional support centers.** 
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Recommendation 2: Transform advising to focus on the 


development of sustained, personalized relationships with 
individual students throughout their college career. 


Introduction 


Advising should be tailored to the individual 
academic, personal, professional, and career 
needs and goals of the student.*® The specific 
needs of each student often change as they 
progress through college. Therefore, the 

expert panel recommends an advising model 
that focuses on the development of sustained, 
personalized relationships with individual 
students throughout their college careers.*° 
Providing sustained, strategic, intrusive, 
personalized, and proactive (SSIPP) advising 
supports that address academic and non- 
academic barriers to college achievement could 
possibly lead to improvements in students’ sense 
of belonging, academic achievement, college 
progression, and degree completion.” 


The panel believes an advising model that 
promotes sustained relationships between 
students and advisors enables advisors to build 
trust and a personal relationship with students, 
allowing advisors to better address the various 
academic and non-academic barriers to success 
each student faces. This might involve adopting 
an Appreciative Advising model, making sure 
advisors have the time to build relationships 
with individual students and understand their 
academic, social, and interpersonal needs, as well 
as making advising more accessible and visible to 
students throughout their college career. 


The importance of the advisor-student 
relationship was also included as an evidence- 
based recommendation in the WWC practice 
guide Strategies for Postsecondary Students 
in Developmental Education. That guide 
recommends that colleges and universities 
“require or incentivize regular participation 


in enhanced advising activities.” It states that 
“an important aspect of enhanced advising is 
a dedicated and lasting interaction between an 
advisor and a student. The purpose is to interact 
personally with the student to foster learning, 
encourage course completion, and decrease 
institutional barriers that limit or prevent 
student participation in the intellectual and 
social life of the college.” *? The panel agrees 
that these same strategies are applicable for a 
wider student population. 


As described in Recommendation 1, to be 

able to offer students such advising, some 
institutional transformation could be necessary. 
Institutions that use advisors to guide students 

in selecting courses but not to provide long- 
term, individualized academic and non- 
academic supports could need to transform their 
advising practices to better meet student needs. 
Transforming the culture and practice of advising 
can require fundamental shifts along structural, 
procedural, and attitudinal dimensions.** For 
example, institutions might need to re-examine 
their advising model and practices, including 

the role advisors play in serving students and 
whether they have appropriate staff and delivery 
mechanisms in place to effectively provide 
comprehensive, integrated advising. 


This transformation of the culture and practice 
of advising could require additional resources 
and investments, such as professional 
development for advisors and smaller caseloads. 
The costs of transforming advising practice might 
be offset by the benefits of improved student 
outcomes, however. Institutions might consider 
investing in technology to help advisors provide 
long-term individualized support to students 
more efficiently.** 
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WWC staff and the expert panel assigned advisor for the duration of their participation 
Recommendation 2 a strong level of evidence, in a particular program (four studies); 

based on 10 studies of interventions that involve 
sustained, personalized advising relationships 
implemented with postsecondary students in the 
United States. Seven of the studies* meet WWC 
group design standards without reservations, and 


the other three studies** meet WWC group design = ._ Interventions intentionally designed 
standards with reservations. The interventions advising to offer social and emotional support 


demonstrated statistically significant and in addition to academic support (three 


¢ Interventions increased the frequency of 
advisor-student interactions by granting 
students priority access to schedule 
appointments with their advisor (four studies); 


positive average effects on progressing in college, studies); and 

academic achievement, and postsecondary 

degree attainment (see Table 4). Evidence ¢ Interventions featured smaller caseloads for 
from the 10 studies provides a direct test of the advisors, allowing advisors to spend more time 
recommendation, as the interventions involve getting to know and meet with the students 
sustained, personalized advising relationships in they were assigned to (three studies). 


five diff : 
ve different ways The panel has a high degree of confidence in the 


« Advisors or coaches had access to data from research suggesting that promoting sustained and 
progress monitoring or early warning systems, personalized advising relationships is an effective 
allowing them to proactively reach out to approach. See Appendix C for a detailed 
students in need of academic and/or non- rationale for the level of evidence assignment for 
academic supports (five studies); Recommendation 2, including descriptions of 

: ; the intervention features and findings from each 
¢ Interventions allowed for sustained study informing this recommendation. 


relationships by pairing students with the same 


Table 4. Results of Meta-analysis for Recommendation 2 


Average Effect of Sustained and Personalized Advising 


Statistically Statistically 
Yefaliicer-laar-lale| Yfefatuiter-talar-lale| 
Outcome Domain positive Indeterminate negative 
Progressing in college @ 
Academic achievement @ 


Postsecondary degree 
attainment 


Note: No studies that meet WWC standards and are relevant to this recommendation included findings in either the credential 
attainment or post-graduation outcomes domains. 
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How to Carry Out the 
Recommendation 


This section describes strategies, examples, 

and tools that can support the transformation 
of advising to focus on the development of 
sustained, personalized relationships with 
individual students. All figures and mentions 

of specific colleges or interventions in 
Recommendation 2 are offered as examples 
only and should not be read as endorsements of 
specific products or approaches. 


1. Meet students where they are 
developmentally and recognize their 
individual needs. 


To meet each student’s unique needs, an 
institution’s advising model should build a 
foundation of understanding the student 
population the advisors will serve, what 
academic and non-academic supports 
those students might require, and how to 
deliver those supports to the students who 
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need them. It is important for colleges to 
remember that individual students’ needs will 
differ depending on their background, such 
as age, gender, race/ethnicity, or relevant 
lived experiences, as well as educational 
goals. As a result, advising for individual 
students could vary in both frequency and 
duration of advisor-student contacts, as well 
as in what topics advisor and student discuss. 


If an institution anticipates that students 

will face a wide range of academic and non- 
academic barriers, a preferred model is one 
robust enough that the advisor can tailor 
support to each student. Tailored advising 
begins with assessing and understanding 

the individual barriers the student 

faces throughout their time in college. 
Comprehensive, integrated advising programs 
at several colleges build in opportunities for 
advisors to learn about non-academic aspects 
of a student’s life, such as health, work, 
family, and financial obligations.*” 


WWC 2022003 


Effective Advising for Postsecondary Students | Recommendation 2 | 26 


Recommendation 2 


Highlights from the Field 


Promoting Sustained, Personalized Relationships with Individual Students: CUNY ASAP 


Acknowledging the variety of barriers to academic success students may face, ASAP provides students with comprehensive 
advising not only on academic issues but also on social and interpersonal issues. During the course of the study, ASAP 
students were required to meet with their assigned adviser in person twice per month throughout each semester; advisers 
also sometimes communicated with students by phone, e-mail, or text message. Advising appointments were tracked, and 
attendance was linked to students’ receipt of monthly MetroCards. ASAP students were assigned an adviser during their 
first semester and usually continued to see the same person throughout their college careers. 


ASAP advisers serve only ASAP students. During the study, they typically held case-loads of 60 to 80 students each 
semester. This caseload was substantially smaller than the national median in community colleges, which the National 
Academic Advising Association puts at 441 students per adviser, and the average at each school where ASAP operates. At 
the three colleges in the study, the ratios ranged from 600 to 1,500 students per adviser. The small caseloads allowed 
advisers to meet with students more frequently and for longer durations. 


ASAP advisers were trained to field a wide variety of topics. In addition to covering the gamut of academic topics, 
including getting acclimated to college, choosing classes, and picking a major, ASAP advisers helped students with 

soft skills, such as study habits and time management, how best to balance home, work, and school demands, and 
extracurricular activities and campus life. ASAP advisers kept their schedules open to students for as much time as 
possible during the day; at schools where ASAP included night and weekend students, ASAP advisers dedicated to night 
and weekend students kept hours late into the evening and for several hours on Saturdays and Sundays. 


Advisers sometimes interacted directly with students’ professors or financial aid officers to resolve issues. ASAP advisers 
reported that they took a forward-looking approach to advising, encouraging students to think early on about aligning 
their college experience with their career goals and planning to transfer to four-year institutions. ASAP advisers also 
helped with personal issues as they arose, either within the advising context or by referring students to other resources. 


(Scrivener et al., 2015) 


2. Design an advising model that enables experience, staying engaged with each until 
individual students to have a sustained they meet their educational goals.** 


relationship with their advisor. . : ue . 
The panel identified the Appreciative Advising 


A holistic approach to advising, where framework, as depicted by Figure 2.1, as one 
the advisor comes to understand the common approach used by academic advisors 
challenges faced by each individual student to enhance the quality of their relationship, 
and connects each with the supports they and ultimately their interactions, with 

need, can improve students’ ability to meet students.*° Appreciative Advising involves 
their academic and non-academic goals. To asking generative, open-ended questions 
promote a sustained relationship, an advisor that help students make the most of their 
should start building a relationship with educational experiences and achieve their 
individual students early on in their college dreams, goals, and potentials.®° 
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Figure 2.1. The Appreciative Advising Framework 


le 


£ Discover 


Make a positive first impression with Ask generative, open-ended questions 
students, to build rapport and create a__ that help advisers learn about 

safe and welcoming space. students’ strengths, skills, and abilities. 
Inquire about students’ hopes and es and advisers co-create a plan 
dreams for their futures. for making students’ dreams a reality. 


Mas Deliver ¥ Don't Settle 


Students deliver on the plan co-created Students and advisers set their own 
during the Design phase, and advisers __ internal bars of expectations high. 
are available to encourage and support 

their students. 


Source: Bloom, Hutson, & He, (2008). 
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The Meyerhoff Scholars Program connects 
advisors with students during a summer 
bridge program, providing them an early start 
to developing a relationship, and expects 
advisors to work with the students throughout 
their time in the program.*' Students 
participating in CUNY ASAP are assigned an 
advisor during their first semester and usually 
continue to see the same person throughout 
their college career (see the Highlights from 
the Field “Promoting Sustained, Personalized 
Relationships with Individual Students: CUNY 
ASAP”). ASAP students are required to meet 
with their assigned advisor in person twice 
per month throughout the 3-year program 
period. ASAP advisors also sometimes 
communicate with students by phone, email, 
or text message. 


Students in the Adelante Scholarship Program 
at Pima Community College, who were either 
incoming students or enrolled students with 
no more than 45 credits, are assigned to work 
with the same advisor all three semesters they 
participate in the program. The advisors help 
each student navigate various college systems, 
provide guidance on strategies for academic 
success, and intervene early if a student is 
falling behind. The purpose of this advising 
model is to allow students the opportunity to 
develop a meaningful relationship with a staff 
member on campus, with whom they could 
also feel comfortable discussing non-academic 
issues such as health, work, and family life. 


Small caseloads allow advisors to meet with 
students more frequently and for longer 
durations. Students participating in the 
Opening Doors initiative at Lorain County 
Community College and Owens Community 
College in Ohio, for example, were offered 
intensive, personalized, and comprehensive 
supports. The advisors in this program, 
referred to as “counselors,” had smaller 
caseloads than other advisors, which allowed 
them to see students more frequently and 
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spend more time with them. The rationale 
for the increased contact was that it would 
allow the counselors to uncover and address 
more issues relevant to the students’ success 
in school.® 


Similarly, small caseloads at the CUNY and 
Ohio ASAP programs allow for frequent 
advisor-student contacts and let ASAP 
provide students with comprehensive 
advising not only on academic issues but 
also on social and interpersonal issues. The 
Ohio ASAP program offers comprehensive 
advising from an advisor with a caseload 

of about 125 students.®° The CUNY ASAP 
program student-to-advisor ratios were 
between 60:1 and 80:1 during the 3-year 
study period of a random assignment study,*’ 
enabling 95 percent of ASAP students to 
meet with an advisor during their first 

year. On average, CUNY ASAP students 

met with an advisor 38 times in the 3-year 
period, compared to the average six times a 
comparison group student in that study met 
with an advisor during that same time.® 


Implement strategies that make advising 
visible and accessible. 


To support student engagement with advising 
services and supports, institutions should 
ensure advising is both visible and accessible. 
Students might not be aware of the multitude 
of academic and non-academic supports 
available to them. Similarly, if services are 
difficult to access—whether due to staff 
shortages, limited hours, or inconvenient 
locations—students might not get the 
assistance they need when they need it. 


To ensure advisors have opportunities to 
meet with students to understand their 
academic, social, and interpersonal needs, 
advisors should have flexible schedules that 
allow them to be available to students during 
some nights and weekends.*® Colleges might 
consider adopting flexible work hour policies 
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to allow staff to better align their hours with 
student availability and promoting remote 
meetings through video communication 
technologies such as Zoom or Skype. 


To make advising supports more visible 

and accessible, institutions might consider 
integrating advising into educational 
activities, such as student success courses 

or orientations; locating the advising 
department centrally on campus; and 
conducting advising where students are 
located, such as within residence halls 

or athletic departments. The Learning 
Communities initiative at Kingsborough 
Community College, a one-semester career- 
focused program for second-semester 
students, provided advising as part of an 
integrative seminar intended to reinforce the 
interdisciplinary teaching in the courses as 
well as to raise awareness of career options.” 


Institutions can also make advising services 
more visible to students through social 
events. The Meyerhoff Scholars program at 
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the University of Maryland Baltimore County, 
a program designed to increase the number 
of underrepresented minorities who pursue 
graduate degrees in science and engineering, 
hosts social and cultural events to provide 
advisors and students opportunities to 
interact outside of formal advising sessions.” 


Institutions could also identify opportunities 
to help students realize the full value of the 
resources available to them throughout the 
college, and to encourage them to access 
those resources. One-on-one advisor-student 
interactions are an ideal time for advisors 

to ask students whether they are aware of 
specific resources that could benefit them. 
The advisor-student conversation featured 
in Figure 2.2 is an example of an advisor 
using a simple, relatable dialogue to help 
their advisee understand the value of “free” 
campus resources. 
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Figure 2.2. Sample dialogue to help students realize 
the full value of available resources 


Van War-Vdlavemacelelo)(-M <at-yo)iaveme) OMY ZiWam ual=Manrcl\clarc1B 


Ok. Let's say that you and | went to dinner at a nice restaurant. At 


Have you been to the learning center to arrange tutoring? 


the table next to us, there is a couple, clearly on a date. At the end 
of their meal, they order dessert. What's your favorite dessert? 


A brownie with ice cream. 


Great. So this couple orders a brownie with ice cream. 
The waiter sets it on the table, and it looks delicious. It’s a 
perfect mound of brownie covered with a perfectly 

cy 0) at=sarer-) ee) | (0) eK) (a-Mol (-y-1an Pu DYomYolUN IL <omr-llanrelare yg 


Sure. 


Ok, it’s also got shaved almonds and whipped cream with 
'aXolmmiU(ole[-Meolayard{-\e Ko)Y(-lmuai-m vo) olr-] avolr-1colUlare muat-m o)[-]\-M Lala.) 
work of art. Immediately after the dessert arrives, the 
couple leaves the restaurant. The dessert is left untouched. 
What would you think if you saw that? 


How long do we have to wait until we eat that dessert?! 


b= oLUL MANY =MAZOL0] (eM (ole) @r-lmdat=MUlalcolulelarzve Ke (=\sxx-) aur) are! 
think, “Wow, that’s weird. Why would anyone pay for 
dessert and then leave without eating it?” Right? 


So let me ask you this, how much does it cost to go to the 
Learning Center or the Counseling Center? 


How much does it cost to go talk to a faculty member? 
Nola altaten 


It costs nothing now, but it’s not free. You hear people talk about 
all of our free resources, but the truth is the resources are not free. 
a CoLUM a-\Vem of-l(0 Me [olere palelarcymvon-]ucclaleKelUlm@laciiideia(olamr-lalemuat=li-) 0) 
have paid for the resources. Since you've paid for them, why 
wouldn't you use them? Eat the dessert! 


(0) aM ColUuc=Male|aieM Mar-relammaarel0(e|alar-) ofolUl mia ll Coma at-l a 


Source: Forbes & DeVasher (2018). 
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Provide professional 
development opportunities for 
advisors, taking into account 
advisors’ learning needs. 


To the extent that advisors are 
required to transform their 
practices, professional development 
can help.” If advisors and other 
support staff are expected to 

form ongoing relationships with 
students, training on how best to 
do so can help advisor-student 
relationships be more fruitful. 
Recommendation 2 in the WWC 
practice guide Strategies for 
Postsecondary Students in 
Developmental Education offers 
detailed strategies for training 
advisors. These include training 
faculty and staff in “the college’s 
concept and definition of the 
advising process, the informational 
aspects of advising, and the 
relationship skills involved in 
supporting students’ decision- 
making and planning.”” Training 
can also teach advisors how to 
conduct advising-as-teaching and 
how to use technological advising 
tools as supports. Institutions can 
provide continuous professional 
development opportunities through 
“brown bag” events and refresher 
sessions. NACADA’s Academic 
Advising Core Competencies, 
summarized in Figure 2.3, might 
also be helpful for institutions to 
consider as they think about which 
knowledge and skills they want their 
advisors to have or develop. 


The expert panel suggests that 
institutions tailor professional 
development to advisors’ learning 
needs, as informed by feedback 
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Figure 2.3. NACADA’s Academic Advising Core Competencies 


ONACADA 


ACADEMIC ADVISING 
CORE COMPETENCIES 


Understanding * Knowledge ¢ Skills 


Supporting Continuous 
Learning 


INFORMATIONAL 


Core competencies in the Informational 
component (knowledge academic advisors 
must master) include knowledge of: 


1. Institution specific history, mission, vision, 
values, and culture. 

2. Curriculum, degree programs, and other 
academic requirements and options. 

3. Institution specific policies, procedures, rules, 
and regulations. 


4. Legal guidelines of advising practice, 
including privacy regulations and 
confidentiality. 


5. The characteristics, needs, and experiences 
of major and emerging student populations. 


6. Campus and community resources that 
support student success. 


7. Information technology applicable to relevant 
advising roles. 


Source: NACADA (2017). 


from advisors about challenges they face on 
the job and potential gaps in knowledge to 
address those challenges. Institutions with 
limited professional development budgets 


CONCEPTUAL 


Core competencies in the Conceptual 
component (concepts academic advisors must 
understand) include understanding of: 


. The history and role of academic advising in 


higher education. 


. NACADA’s Core Values of Academic 


Advising. 


. Theory relevant to academic advising. 
. Academic advising approaches and 


strategies. 


. Expected outcomes of academic advising. 
. How equitable and inclusive environments are 


created and maintained. 


C}) RELATIONAL 


Core competencies in the Relational 
component (skills academic advisors must 
demonstrate) include the ability to: 


1. 


Articulate a personal philosophy of academic 
advising. 


. Create rapport and build academic advising 


relationships. 


. Communicate in an inclusive and respectful 


manner. 


. Plan and conduct successful advising 


interactions. 


. Promote student understanding of the logic 


and purpose of the curriculum. 


. Facilitate problem solving, decision-making, 


meaning-making, planning, and goal setting. 


. Engage in ongoing assessment and 


development of self and the advising practice. 


should not underestimate the value of peer 
professional development, both within and 
across various departments on campus. 
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5. Use technology and data to promote 


efficient individualized advising. 


The human element to advising should 

be maintained, but advisors can leverage 
technology to provide more efficient, 
individualized advising.“ Technology that 
provides information about students’ 
academic standing can help advisors reach 
them more efficiently by flagging which 
students are in need of immediate intensive 
support and for which a lighter touch could 
be sufficient.” 


The panel identified InsideTrack® as 

an example of a program using more 
individualized advising supports. 
InsideTrack partners with universities to 
deliver proactive, personalized coaching 

to help students identify and overcome 

both academic and non-academic barriers 
to college persistence and graduation.” 
InsideTrack coaches call their students 
regularly and, in some cases, have access to 
course syllabi, transcripts, and additional 
information on students’ performance and 
participation in specific courses. InsideTrack 
uses this additional information, along with 
predictive algorithms, to be able to reach out 
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to students on the right issues at the right 
times. This background knowledge makes 
conversations between coaches and students 
both individualized and focused on success 
in school.” 


To facilitate the holistic counseling in the 
Opening Doors program, two Ohio colleges 
created their own database to record key 
information about participating students and 
their contacts with staff. Counselors recorded 
their in-person and telephone contacts with 
students, including meeting duration and 
the topics covered. They sometimes also 
noted email or postal mail communications. 
If students met with an Opening Doors 
counselor who was not their primary 
contact, the database allowed those staff to 
review the student’s records, facilitating the 
team approach.” 


The iPASS initiative, featured in a Highlights 
from the Field in this chapter, used a variety 
of advising technologies to better serve 
students, including education planning 
tools, early-alert systems, predictive 


analytics, learning management systems, and 
communication tools.” 
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Highlights from the Field 


Promoting Efficient Individualized Advising Through the Use of Technology: Enhanced iPASS 


Early alerts and predictive analytics can inform advisers about the nature and degree of each student’s needs, allowing 
the advisor to strategically allocate their limited time and capacity to provide the most intensive support to the students 
who need it the most. For example, advisers may differentiate interventions for students depending on the number 
and type of early-alert flags students receive; those who receive multiple flags may be considered at higher risk and be 
required to meet with an adviser, while students with one flag may be sufficiently served with outreach from an adviser 
via email. 


Communication tools can also help advisers and other personnel coordinate with each other when intervening with a 
student so that the student receives a coherent message from across the institution. For example, when an adviser uses 
this technology to refer a student for services like tutoring, not only the student but also the tutor or other staff member 
providing the service can see the referral; the tutor can then follow up with the student. The adviser can also see 
whether and when the student acts on the referral and can later inquire about the student’s experience with the service 
or ask why the student did not follow through with it. 


A shared note-taking platform is another common benefit of communication tools; colleagues can see each other’s notes 
about their interactions with students. When meeting with a student who has been served before, staff members can 
draw on the notes to engage in a more personalized dialogue with the student. These tools are also designed to make it 
easier for staff members to align their advising with previously offered information and guidance. 


Advisers’ interactions with students can assume a more instructional focus with the support of data and functions 
available from advising technologies. These technologies also allow advisers to track students’ progress toward a degree 
more efficiently. For example, some education planning tools notify the student and the adviser when a student attempts 
to enroll in a course that is not part of his or her course plan; the adviser can then either intervene to get the student back 
on track or approve the modification. Overall, by enabling advisers and students to engage in multi-semester program 
planning and making it easier for students and advisers to know when students are off track, information gathered using 
these tools can motivate discussions that can help students attain their long-term academic and career goals. 


While technology can make it easier to realize the objectives of high-quality advising, adopting technology-based 
practices at full scale often requires redesigning advising structures and practices, which can be a lengthy, iterative 
process. One study found that the institutions that were most successful at using technology to change how students 
experience support reassessed and improved their advising structures and practices on several occasions. The 
comprehensive student advising experience envisioned in the iPASS model requires time, resources, and continual 
refinement of structures and practices to achieve. 


(Mayer et al., 2019, p. 9-10) 


6. Continuously monitor student progress benchmarks, such as meeting advising 
toward their educational goals. participation requirements, that serve as 
indicators of the impact of the advisement 


Monitoring students’ progress toward their modelonsiident ouleunes: 


educational goals will inform whether 


each student is on track to succeed, and Similarly, the iPASS initiative uses a 
whether intervention by an advisor might variety of technologies to track students’ 

be beneficial. CUNY ASAP emphasizes the progress toward their educational goals. 
importance of creating data collection and For example, advisors can use information 
Management systems that allow for timely about a student’s predicted probability of 
intervention. Such systems let advisors persisting and early indications of academic 
regularly assess students’ progress toward risk to prompt a more comprehensive 


WWC 2022003 Effective Advising for Postsecondary Students | Recommendation 2 | 34 


discussion during the advising session about 
the student’s progress and strategies for 
achieving academic and career goals. In 
addition, advisors can use education planning 
tools to help students clarify what path they 
want to pursue and map out the courses 
that students need to take each semester to 
complete a program of study. In some cases, 
advisors and students can make multiple 
plans, allowing students to compare the 
courses they would need to take to complete 
a degree for different programs.®*° 


Interviews or student surveys can be used by 
administrators and advising staff to monitor 
students’ perceptions of whether their needs 
are being met as they navigate college. If 
students are not meeting their educational 
goals, it is important to understand why and 
whether advising supports could have helped 
students overcome barriers. For example, 
surveys and interviews conducted by the 
Meyerhoff Scholars Program revealed which 
supports students viewed as most critical for 
meeting their educational goals.*' Institutions 
can use similar information to refine or 
enhance their approaches to comprehensive 
student advising, especially if these data 
identify weaknesses in the supports currently 
offered and delivered to students. 
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Potential Obstacles and the 
Panel’s Advice 


OBSTACLE: Students could have a limited view 
of the role advisors can play in their college 
experience, and might have limited time available 
to build a relationship with their advisor. 


PANEL’S ADVICE: College students can be 
hesitant to engage in a long-term, personal 
relationship with their advisor, either because 
the college is not providing sufficient information 
about the benefits of engaging with an advisor 
or the student has limited time available after 
outside obligations such as dependent care or 
work. Institutions can communicate to students 
that their advisor can function as a trusted ally 
for overcoming academic and non-academic 
barriers, and that meeting with their advisor is 
not simply a requirement of the course selection 
and registration process. NACADA emphasizes 
the importance of this type of outreach in its 
approach to increasing student engagement, 
which features the following: (1) marketing 

and outreach; (2) relationship building; and (3) 
developing student-centered programming.* 


To underscore the importance of advisor-student 
relationships, institutions could consider hiring 
more advisors to allow for smaller advising 
caseloads, which might promote relationship 
building and a more student-centered approach 
to advising. The Appreciative Advising 
framework, as depicted in Figure 2.1 above, 

is one common approach used by academic 
advisors to enhance the effectiveness of their 
interactions with students. Figure 2.4 below 
provides principles for advisors aiming to 
develop advisor-student relationships. 
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Figure 2.4. Principles for developing 
advisor-student relationships 


Empathy - understanding the student; ability 
to see students’ problems & concerns through 
their eyes 


Respect - belief in a student’s worth & potential; 
non-judgmental acceptance 


Warmth - caring, concern for student; totally 
attentive & nonverbally supportive 


Concreteness - specificity & clarity; ability to 
recognize vagueness & specificity in student's 
statements; as individuals become more concrete 
& specific they are also able to be more clear & 
specific about their concerns 


Genuineness - ability to be real & honest; 
verbalizations are congruent with inner feelings; 
advisor is not role-playing; genuineness can lead to 
increased trust in advisor from student 


Self-Disclosure - advisor shares experiences 
& feelings similar to those of the student at 

an appropriate time; appropriateness is a key 
component; self-disclosure can be distracting & 
even harmful to relationship if poorly timed 


Confrontation - ability of advisor to illustrate to 
the student a discrepancy between what student 
says & what he/she does; least threatening when 
discrepancies are ones that the student is sharing 


Immediacy - “telling it like it is,” between advisor & 
student in the here & now; focusing on the present 
& immediate interactions 


Source: Florida State Undergraduate Advisor Handbook, 
2018, page 18. 


To meet the needs of students with obligations 
outside of school, such as nontraditional 
students, institutions should ensure that an 
increased number of advisors are available, both 
in person and virtually, on nights and weekends 
to engage with students when they are on 
campus or learning remotely.* 


Students who are hesitant to meet with an 
advisor might be receptive to incentives to 
do so (see Recommendation 4 for more 
detail). As they develop a relationship with 
their advisor, students could decide that 
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continued engagement is beneficial and no 
longer need incentives to meet with their 
advisor more regularly. 


OBSTACLE: Institutions can face challenges 
hiring advisors who relate to and reflect the 
student population. 


PANEL’S ADVICE: Students could be more 
willing to embrace a long-term relationship with 
an advisor they can relate to. However, colleges 
can face challenges building a department of 
advisors who themselves come with the wide 
range of backgrounds observed in the student 
population. Institutions might need to rethink 
their recruitment and hiring processes to create a 
stronger pool of advisors that reflects the cultural 
backgrounds of the students they serve. At the 
same time, institutions can generally be more 
thoughtful during recruitment and hiring by 
asking all candidates to describe their advising 
philosophy and to answer situational questions 
that are relevant to the advising roles they will be 
responsible for if hired. 


Regardless of whether an advisor shares the same 
background with a given student, it is important 
that the advisor takes an encouraging approach 
that both recognizes and validates students’ 
individual feelings and experiences.* Dialogue 
that encourages students’ values and beliefs will 
help them trust the advisor and promote self- 
integrity. For example, the Adelante Scholarship 
Program sent messages that conveyed to students 
that they could be successful in college, that 
validated their experiences as Latino men, and 
that reinforced the Adelante Program group 
identity. The program also selected a Latino man 
to facilitate its platicas, small-group conversations 
where students could discuss obstacles and issues 
experienced by Latino male students both on 
campus and in their communities.* Professional 
development requirements for advisors can 
include trainings on strengths-based advising and 
implicit bias so that they understand how to best 
support students who come from backgrounds 
that differ from their own. 
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Institutions might consider offering ongoing 
training to help advisors develop meaningful 
relationships with all of the students they serve, 
regardless of how much they have in common 
with their students’ backgrounds. For example, 
the University of California Davis offers a four- 
part course, “Developing Deeper Advising 
Relationships,” that is mandatory for all college 
and departmental advisors. A description of this 
course is provided in Figure 2.5. 


Figure 2.5. Developing deeper advising 
relationships 


Developing Deeper Advising Relationships is a 
four-part series that is mandatory for all college and 
departmental advisors at UC Davis. 


Session (4) The Role of Social Justice 

in Advising 

Session 1 of the workshop series was fostered by 
the work of the Social Justice Advisory Committee; 
it focuses on establishing a common definition and 
understanding of social justice on campus and its 
importance in academic advising. Topics include: 
understanding equity vs. equality in a university 
setting, acknowledging limitations and biases, brave 
space vs. safe space, and using inclusive language. 


Session (2) Self-Awareness and Awareness of 
One’s Own World View 


Session 2 focuses on the importance of self- 
awareness and offers participants the opportunity to 
engage in dialogue about their multiple identities and 
how those identities impact their work with a diverse 
student population. 


Session (3) Cultural Humility: Unpacking Bias 
and ‘Ally’ as a Verb 


Session 3 promotes the creation of a Brave Space in 
advising, incorporating Cultural Humility, discusses 
the impact of stereotypes and bias on us all, and 
developing as an Ally in our campus community and 
advising practice. 


Session (4) Developing Effective 
Communication Skills 


Session 4 provides staff with the tools for developing 
more effective communication skills and the ability 
to understand, communicate with, and effectively 
interact with students across individual contexts 

and cultures. 


Source: University of California, Davis (n.d.). 
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OBSTACLE: Institutions have resource constraints 
that can limit opportunities to reduce advisors’ 
student caseloads. 


PANEL’S ADVICE: Large student caseloads can 
limit the frequency and duration of interactions 
between students and their advisors. When faced 
with resource constraints, colleges could consider 
requiring more intensive advising for students 
who meet certain criteria and less for others. 


To accommodate larger advisement caseloads 

as a result of CUNY ASAP’s expansion, CUNY 
ASAP developed a needs-based approach to 
advisement. CUNY ASAP advisors have individual 
meetings with students twice a month during the 
students’ first semester so advisor and student 
can establish a strong bond and complete a 
comprehensive needs assessment. After the first 
semester, students are sorted into one of three 
support levels—high, medium, and low—based on 
three criteria: (1) academic progress, (2) personal 
resiliency, and (3) compliance with CUNY ASAP 
requirements.* The characteristics of CUNY ASAP 
students that align with placement in the high-, 
medium-, and low-needs advisement groups are 
summarized in Figure 2.6. 
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Figure 2.6. Characteristics of CUNY ASAP’s 
needs-based advisement groupings 


PANSYAN edo lel 0) oo) a il MENA) [33 


Source: The City University of New York (2020). 
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The Ohio ASAP Replication Demonstration, as 
another example, required students to meet with 
their advisors twice each month during their 
first semester of the 3-year program. Starting in 
the second semester and extending through the 
end of the program, advisors “triaged” students, 
sorting them into low-, medium-, and high- 
support groups. Students in the high-support 
group continued to meet with their assigned 
advisor twice per month. Students in the medium- 
and low-support groups were in many cases 
required to meet with their advisor at least once 
per month.*’ 


Another approach institutions could adopt 

is flipped advising, which requires students 

to complete their “homework” prior to each 
meeting with their advisor. This is meant to 
make advisor-student meetings more efficient by 
freeing students and advisors to spend more of 
their time together planning and decision making 
and less time with the advisor simply conveying 
information. Flipped advising changes the focus 
and content of what takes place in and outside 
of advising sessions. For example, whereas 
traditional advising would devote the advising 
session to understanding and remembering 
information, flipped advising instead focuses 

the advising session on applying, analyzing, 
evaluating, and creating, under the assumption 
that the student will commit to understanding 
and remembering outside of the advising session 
(Figure 2.7).°8°9 
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Figure 2.7. Flipped advising and critical thinking as illustrated by Bloom’s Cognitive Taxonomy 
of Learning 


OUTSIDE THE ADVISING SESSION 


Creating —— 
“Flipped Advising” 
Analyzing Remembering 
Applying UT ate (Tele laleliare! 
Understanding Applying 


Remembering Analyzing 


“Traditional Advising” 


——~ Creating 
IN THE ADVISING SESSION 


Source: Williamson et al. (2018). 
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Recommendation 3: Use mentoring and coaching to enhance 


comprehensive, integrated advising in ways that support students’ 
achievement and progression. 


Introduction 


Mentoring and coaching are promising practices 
that can enhance the role advisors play in 
supporting students as they work to reach 

their educational goals. Though the terms 
“mentoring” and “coaching” are sometimes 
used interchangeably, mentoring and coaching 
both are different from advising, and often 
differ from each other. Clear distinctions in 
roles—and clear communication about what 
those roles entail—can ensure that mentors and 
coaches complement advising appropriately. The 
role of the mentor or coach should be clearly 
defined and should enhance traditional advising 
functions, such as course planning, to increase 
the value of student supports. 


“Mentoring” describes a supportive learning 
relationship between a student and a mentor. 
Mentors are usually a faculty member,” a 
student peer,” or a professional*? with 

experience and knowledge in the student’s 
desired field. The mentor is someone who shares, 
or can empathize with, a student’s life experience 
and who is committed to providing support, 
sharing their experiences, and offering guidance, 
ideally serving as an informal role model to 

the student.*° 


“Coaching” usually is more formal and 
structured, anchored in specific student learning 
or development goals. Coaches use active 
listening, questioning, feedback, and goal- 
setting techniques to help students develop 
new perspectives, strategies, and skills toward 
their personal and professional goals. Coaching 
is increasingly becoming professionalized, 

with “student success coaches” undergoing 
specialized training and following specific 
coaching models in their work with students.” 


Advising, mentoring, and coaching each play an 
important role in a comprehensive approach to 
student supports, and they all share a focus on 
student development, supporting students in 
moving from where they are to where they want to 
be. Some coaching and mentor programs serve 
students campus-wide, whereas other programs 
are tailored and offered to specific groups of 
students. Mentors and coaches can play an 
important role in providing motivation and 
helping students set and achieve goals. Mentors 
and coaches also offer the benefit of providing 
someone-—in addition to the advisor—who can 
establish a personal connection with students. 
In this way, mentoring and coaching can be 
important components of providing holistic 
student supports (see Recommendation 1). 


WWC staff and the expert panel assigned 
Recommendation 3 a strong level of evidence, 
based on 12 studies of interventions that include 
mentoring or coaching implemented with 
postsecondary students in the United States or 
Canada. Eight of the studies®* meet WWC group 
design standards without reservations, and the 
other four studies®* meet WWC group design 
standards with reservations. The interventions 
demonstrated statistically significant and 
positive average effects on progressing in college, 
academic achievement, and postsecondary 
degree attainment (see Table 5). Evidence 

from the 12 studies provides a direct test of the 
recommendation, as mentoring or coaching 

is a primary component of the intervention in 
eight studies and a secondary component of 
the intervention in four studies. Mentoring or 
coaching was provided through: 


¢ Peer mentors (eight studies); or 


¢ Coaches or faculty mentors (two studies). 
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Table 5. Results of Meta-analysis for Recommendation 3 


Recommendation 3 
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Statistically Statistically 
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Outcome Domain positive Indeterminate negative 
Progressing in college @ 
Academic achievement td 


Postsecondary degree 


attainment . 


attainment or post-graduation outcomes domains. 


The types of activities, frequency of meetings, 
and duration of the mentoring or coaching 
relationship varied considerably across the 
interventions studied. The panel has a high 
degree of confidence in the research suggesting 
that mentoring and coaching are effective 
practices. See Appendix C for a detailed 
rationale for the level of evidence assignment for 
Recommendation 3, including descriptions of 
the intervention features and findings from each 
study informing this recommendation. 


How to Carry Out the 
Recommendation 


This section describes strategies, examples, and 
tools that support using mentoring and coaching 
to enhance advising practices. All figures and 
mentions of specific colleges or interventions 

in Recommendation 3 are offered as examples 
only and should not be read as endorsements of 
specific products or approaches. 


1. Determine whether, and if so how, 
mentors or coaches could be used to 
enhance the supports students 
currently receive. 


The panel recommends that college 
leadership and advisors identify the gaps in 
student supports that could be effectively 


Note: No studies that meet WWC standards and are relevant to this recommendation included findings in either the credential 


addressed by mentors or coaches. This 
involves thinking carefully about the role 

and purpose of the mentors and coaches and 
how they can best help students achieve their 
educational goals. 


Peer mentors can help students use 
technology, show them how to enroll in 
courses, unmask the hidden curriculum and 
hidden rules of college, and provide tips 

and tricks on how to adjust to college and 
navigate the campus.” One summer bridge 
program, designed for first-year students at 

a large public 4-year college, hired previous 
program participants to serve as peer 
mentors. The role of the mentors was to 
connect with students, serve as an academic 
role model, advise on first-year adjustment 
issues, and be available to listen to student 
concerns and questions.°* Peer mentors can 
also help students become more engaged in 
campus activities or apply for scholarships or 
leadership programs.°? Finally, peer mentors 
can be less intimidating for students to 
approach with questions, can help normalize 
feelings and concerns, and even model how 
to Overcome common transitions and barriers 
in college.’ 


Faculty mentors can provide insights to 
their field of study, access to research and 
internship opportunities, or guidance on 
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pursuing further education.’ For example, 
faculty mentors might provide students 

with answers to questions such as, What 

do you do with a biology degree? How do you 
get there? Are there biologists who look like 
me? Faculty mentors can also serve as role 
models for students. Whether they are faculty 
members or peers, mentors often provide 
guidance based on their personal knowledge 
and experience, usually through informal 
interactions with the student. 


In contrast to mentors, coaches focus their 
guidance on students’ specific personal and 
academic development goals. Coaches might 
not have expertise in a student’s specific field 
or area of interest, but they are professionally 
trained in facilitating conversations 

that promote purposeful self-reflection, 
development, and skill-building. This could 
include reflecting on personal strengths and 
weaknesses, interests, and aptitudes, as well 
as the connection between these traits and the 
student’s personal growth and career goals.' 


For the integration of advising, mentoring, 
and coaching to be effective, clarity on the 
role and purpose of each type of support 
ought to be established and shared by 
advisors, mentors, and coaches. Institutions 
should make sure advisors, mentors, and 
coaches are aware of the responsibilities 
and functions of their own role as well as 
others’ roles. This is particularly important 
for institutions that offer both advising and 
coaching, which often overlap in practice. 
For example, advisors might integrate 
coaching strategies into their work with 
students and also combine some of their 
coaching functions with their academic 
advising functions. Likewise, some coaches 
might engage in triaging and basic needs 
engagement with students. Some institutions 
now employ professional academic coaches 
to perform many of the expanded advising 
functions the panel recommends in this 
guide, leaving more traditional advising 
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functions, such as course planning, selecting 
a major, and applying for graduation, to 
the advisors. 


Finally, institutions should ensure individuals 
serving in each of these roles receive training 
that aligns with their responsibilities 

and functions. 


Decide who will deliver mentoring 
and/or coaching. 


The panel recommends that institutions 
carefully consider who will be providing 
mentoring or coaching or both. Faculty 
members, students’ peers, or outside 
professionals might all be well suited to serve 
as mentors or coaches. However, each will 
have their own strengths and weaknesses, 
competing responsibilities and demands 

on their time, and levels of training and 
preparation for taking on either role. 


For peer mentoring, some programs use 
juniors and seniors,'°> whereas others use 
graduate students who share the student’s 
academic interest.'°* One peer mentoring 
program, at a 4-year college in Massachusetts, 
paired female college students entering an 
engineering major with a peer mentor who 
was an advanced engineering student. 
Mentors were all juniors or seniors and 
had declared majors in one of the four 
engineering departments. 


It can be helpful for students to be paired 
with a mentor whom they can authentically 
connect with, such as someone who is 

similar in academic interests or background 
characteristics such as age, gender, race/ 
ethnicity, or relevant lived experiences.’ 
Faculty mentors are often paired to mentees 
based on academic interests. As part of a one- 
year faculty mentoring program for students 
from underrepresented groups at a 4-year 
college, participants were matched with 
volunteer faculty mentors after classes began, 
based on their shared academic interests.'” 
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The panel recommends that if outside 
professionals are used as mentors, they 
should also be matched based on academic 
interest. For example, through the Meyerhoff 
Scholars Program, students were paired with 
a mentor who was a professional in a science, 
engineering, or mathematics occupation.’ 


For coaching, which often requires more 
formal training than mentoring does, 
some colleges hire outside vendors such as 
InsideTrack® to provide their coaching.'©° 
Other colleges train and use in-house 
support staff. 


Focus mentoring on topics that prepare 
students for advising. 


The work of mentors and advisors can be 
complementary, and the activities they 
undertake with students should be structured 
to maximize the benefits of both. The 

panel recommends developing or adopting 
topics for mentors to cover with students 
that prepare them to get the most out of 
meetings with their advisor. Broadly, these 
topics include how to clarify academic and 
career interests; how to identify, access, 

and navigate campus resources; and general 
academic planning."° Specific discussion 
topics for mentors and mentees may include: 


- Navigating the course registration 
process, including how to access systems 
or platforms 


« Accessing campus and departmental 
resources 


¢ Networking and getting to know faculty 
and staff 


- Adjusting to college-level academic 
expectations 


¢ Choosing electives 
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¢ Balancing academic demands with 
personal responsibilities and socializing 


¢ Getting involved with student 
organizations that align to personal or 
professional interests 


After discussing these topics with their 
mentors, students would be better prepared 
to discuss similar questions with their 
advisors during formal conversations on 
academic planning. 


Mentors can also play an important role in 
building student motivation and willingness 
to seek out and access advising. The panel 
suggests that topics requiring more specific 
knowledge of college requirements and 
procedures, such as course selection for 
specific majors, as well as more complex 
personal and non-academic issues, are 

best covered by professional advisors 

and counselors. 


Carefully consider the format, frequency, 
and duration of mentoring or coaching. 


Mentoring and coaching can be implemented 
in many different ways. Some mentoring and 
coaching programs are delivered in person," 
others combine in-person and virtual 
meetings."” Mentoring and coaching can be 
short in duration (one semester or less)'* or 
last an entire academic year." The frequency 
(weekly, bi-weekly, or monthly) can also vary. 
Students can meet with mentors and coaches 
one-on-one or in a group format. 


The panel recommends adopting a student 
perspective when deciding on the format, 
frequency, and duration of mentoring and 
coaching. This could involve the following 
considerations: 


¢ Would certain formats, such as in-person 
or online, make mentoring or coaching 
more accessible to specific students or 
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groups of students, including commuter 
students and students with full-time jobs? 


* Would students benefit from discussing 
certain topics in a one-on-one ora 
group format? 


e How much time would students need 
with their mentor to build mutual rapport 
and trust? 


- Are there certain time periods when 
students might need more frequent 
contact, such as end-of-semester or right 
before degree completion? 


5. Provide mentors or coaches with initial 


and ongoing training. 


The expert panel believes that training 

is critical for effective mentoring and 
coaching."> The panel recommends the focus 
of the training be tailored to the role and 
purpose of the coaching and mentoring and 
could include: 


¢ Clarifying the purpose and responsibilities 
of mentoring and coaching; 


¢ Introducing mentors/coaches to resources 
and topics to cover with students, such 
as how to identify student goals, review 
academic maps/plans, and explore 
campus resources; 


¢ Specifying relevant legal and regulatory 
aspects of student mentoring and 
coaching; 


¢ Providing guidelines for when and how to 
refer students to professional advising and 
counseling; and 


¢ Sharing strategies for how to support 
student development within a broader 
team or structure of student supports. 


The panel suggests institutions should make 
sure that the purpose and responsibilities 
of advisors, coaches, and mentors are 
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clearly defined; aligned with their training, 
professional scope, and contractual roles; 
and carried out according to a shared 
understanding of how each type of support 
can best help students achieve their 
educational goals. Shared training on roles 
and responsibilities, including decision rules 
on referrals from peer mentors to advisors 
and vice versa, can support a coherent 
experience for the student. 


One peer mentoring program provided 
mentors with training that covered 

topics such as “mentor-mentee dyad role 
expectations, mentoring phases, effective 
mentoring skills, interpersonal relationship 
building, communication skills, and conflict 
resolution.” "* Another mentor training 
involved presentations from staff in career 
development and placement, the tutoring 
center, financial aid, student support 
services, counseling, the Dean of Students 
office, the athletics department, and other 
student support groups, as well as a panel 
discussion by previous mentors." 


For mentoring programs designed to serve 
specific student groups, training for mentors 
should be tailored to that group’s unique 
needs."® For example, the peer mentor 
training for an “ethnic-based mentoring 
model” for Black college students at a 
predominantly White public 4-year university 
included tailored training modules on racial 
identity and sense of belonging for Black 
students and the basic theories behind 
mentoring, in general and in ethnicity- 

based mentoring specifically. This training 
was followed by a more in-depth training 
that addressed adjustment issues for Black 
students at predominantly White institutions, 
as well as small group supervision meetings 
that met for 2 hours every other week over 
the year. Supervision allowed mentors 

to discuss their experiences and receive 
guidance and troubleshooting as needed.'” 
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Potential Obstacles and the 
Panel’s Advice 


OBSTACLE: During budget crunches or when 
faced with limited staffing capacity, institutions are 
sometimes tempted to have peer mentors take on 
advising responsibilities. 


PANEL’S ADVICE: Peer mentoring complements 
advising but should not be a replacement for 
advising. Instead of colleges replacing trained 
advisors with peer mentors when faced with 
decreased budgets and increased student needs, 
they should consider alternative ways to make 
advising more efficient. Ways to make advising 
more efficient include replacing one-on-one 
advising sessions with group or virtual advising 
formats or making routine information-sharing 
aspects of advising available in online formats, 
such as webinars or video tutorials. 


Peer mentors can also complement advising by 
doing initial triage, by helping students prepare 
for their advising sessions, or by helping with 
procedural aspects of course selection and 
registration. These strategies allow advisors to 
focus their time on more complex academic and 
non-academic challenges their advisees face. 


OBSTACLE: Mentors deployed as volunteers and 
without supports for mentoring activities might not 
stay committed to their role. 


PANEL’S ADVICE: The panel recommends 

that to the extent possible, colleges provide 
mentors with training, compensation, and funds 
to support mentoring activities. Formalizing 
mentoring programs can be achieved through 
ongoing training and supervision of mentors,!”° 
by developing manuals and handbooks," or 

by using checklists to structure and guide the 
mentoring process. Mentors can be compensated 
monetarily or in other forms, such as course 
credit (for peer mentors)'” or release time (for 
faculty and staff mentors). 
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To support mentoring activities, colleges can 
also provide funds or host mentor-mentee 
interactions. One faculty mentoring program, for 
example, offered each mentor a yearly allowance 
of $150 per student mentored to be used for 
professional development expenses—such as 
research costs, professional membership dues, 
or scholarly journal subscriptions—or activities 
involving the mentee, such as lunch with the 
student or joint attendance at a sporting event. 
In addition, a small grant program was set up for 
related student activities, such as research with 
the mentor or travel to a research conference. 

It also sponsored several workshops with 
catered meals for the mentors and their students 
and distributed numerous small tokens of 
recognition, such as coffee mugs and pens.”? 


OBSTACLE: It can sometimes be difficult to recruit 
mentors and coaches who reflect the diversity of a 
campus’s student population. 


PANELS ADVICE: Institutions can face 
challenges recruiting diverse mentors and 
coaches. The panel suggests developing targeted 
mentoring and coaching programs that focus 

on and are tailored to specific student groups. 
This is particularly important when addressing 
the needs of historically underserved student 
populations. In a mentoring model focusing 

on Black students at predominantly White 
institutions, one program recruited Black 
students and faculty to serve as mentors, 
matching them with Black students during social 
events. Similarly, the Meyerhoff Scholars 
Program is tailored for underrepresented 
minority students in STEM majors, matching 
mentors and mentees on race.’ Other programs 
match mentors and mentees on gender.”° Yet 
another strategy is to intentionally recruit 

and hire faculty and peer mentors who have 
experience working with diverse populations.’ 
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Recommendation 4: Embed positive incentives in intentionally 


designed advising structures to encourage student participation 
and continued engagement. 


Introduction 


Students might not always engage with 
comprehensive advising services, even if they 
would benefit from doing so. For this reason, 

the panel recommends that institutions consider 
ways to entice students who would benefit most 
from these services to use them, and then sustain 
their engagement. 


Students who are incentivized to engage with 
comprehensive advising services ideally will 

see value in the advisor-student relationship 

and the academic and non-academic supports 
that are available to them. The hope is that if 
students realize the benefits of these services, 
they choose to continue to engage with their 
advisor and the supports more frequently and 
voluntarily. Because not all students need the 
same type or amount of support, the panel 
suggests institutions determine which students or 
groups of students they want to target and what 
might incentivize those students specifically. 

It is important that even those students who 

are deemed to be “on track” are aware of the 
supports available and that they feel comfortable 
and capable of accessing them if necessary. 


Many institutions specify when students are 
required to meet with their advisors, and they 
might employ negative consequences, such as 
registration holds, when students do not do as 
the college requires. It can be tempting to build 
penalties into a traditional advising model, 
around its quick, transactional interactions 
with students such as course selection and 
registration, reviewing degree requirements, and 
reviewing financial aid procedures.” Instead, 
the panel recommends institutions embed 
positive incentives, which tend to be more 
likely to encourage students’ participation and 


continued engagement with their advisor and the 
academic and non-academic supports they need 
to succeed.” 


WWC staff and the expert panel assigned 
Recommendation 4 a strong level of evidence, 
based on six studies of interventions that 
include embedded incentives implemented with 
postsecondary students in the United States. All 
six studies®° meet WWC group design standards 
without reservations. The interventions 
demonstrated statistically significant and 
positive average effects on progressing in college, 
academic achievement, and postsecondary 
degree attainment (see Table 6). Evidence 

from the six studies provides a direct test of the 
recommendation, as incentives are a primary 
component of the intervention in four studies 
and a secondary component of the intervention 
in two studies. The studied interventions 
included two different types of incentives: 


¢ Student scholarships that were tied to 
academic milestones, credit hours, and/or 
grades (four studies); and 


¢ Monthly incentives—either a small stipend or 
transportation benefits—that students received 
when they participated in advising, tutoring, 
and/or career services (two studies). 


The scholarships were designed to incentivize 
students to perform satisfactorily and to persist 
with their studies. The monthly incentives, 

on the other hand, were designed to remove 
barriers that prevented students from attending 
classes while also encouraging them to access 
supports that were available to promote their 
academic and personal success. Two of the 
interventions that offered students scholarships 
also required students to regularly meet with 
dedicated advisors. The panel has a high degree 
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Table 6. Results of Meta-analysis for Recommendation 4 


Recommendation 4 


Average Effect of Embedded Incentives 


Statistically Statistically 
Yefaliicer-lalar-lale| YfeTatniter-talar- ale} 
Outcome Domain positive Indeterminate negative 
Progressing in college @ 
Academic achievement td 


Postsecondary degree 


attainment . 


of confidence in the research suggesting that 
embedded incentives are an effective practice. 
See Appendix C for a detailed rationale 

for the level of evidence assignment for 
Recommendation 4, including descriptions of 
the intervention features and findings from each 
study informing this recommendation. 


How to Carry Out the 
Recommendation 


This section describes strategies, examples, 

and tools that can support using incentives in 
intentionally designed advising structures to 
encourage student participation and continued 
engagement. All figures and mentions of specific 
colleges or interventions in Recommendation 4 
are offered as examples only and should not be 
read as endorsements of specific products 

or approaches. 


1. Offer incentives for students to engage 
with available supports. 


The panel recommends that institutions 

use strategies, practices, and incentives that 
encourage students to stay engaged with 
the academic and non-academic supports 
available to them. Incentives might be 
financial, such as gift cards, book vouchers, 


Note: No studies that meet WWC standards and are relevant to this recommendation included findings in either the credential 
attainment or post-graduation outcomes domains. 


transportation passes, parking permits, 

food, or subsidized childcare. Non-financial 
incentives might include priority registration, 
priority meeting times with advisors, or 
access to additional courses at no cost. When 
selecting incentives, the panel suggests 
institutions determine which students 

or groups of students they want to target 

and what might incentivize those students 
specifically. For example, when considering 
how to overcome barriers to transportation, 
one student might need a parking permit 
whereas another might want a bus or train 
pass. Institutions must also consider their 
available resources, as this will determine the 
type and frequency of incentives they offer. 


Coupling the distribution of incentives with 
specific advising meetings or functions can 
help increase the likelihood that students 
participate in those meetings or functions. 
For example, the CUNY ASAP program 
tracked advising appointments 

and discovered attendance at appointments 
was higher because those appointments 
were linked to students’ continued receipt 
of monthly MetroCards.™! See Figure 4.1 
for more information about how the 
MetroCard motivated students to succeed in 
that program. 
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Figure 4.1. How CUNY ASAP’s MetroCard 
motivates students to succeed 


Javier and the Value of the MetroCard Incentive 


Javier is a Latino man who enrolled in community 
college immediately after high school. He was not 
interested in college, but his parents, who do not 
have college degrees themselves, convinced him 

it was important to continue his education. Javier 
took the CUNY placement exam and found out that 
he would have to take developmental courses in 
reading and math. 


Javier had struggled with math throughout high 
school and continued to struggle in college, failing 
his developmental math course twice before his 
ASAP adviser suggested he retake the course 
during an intersession, when he could focus on 
just that class. That time, he passed and got 
through the requirement. 


Javier’s ASAP adviser found that he really struggled 
to motivate himself, since he was not very interested 
in his chosen major or in the classes he had to 

take. He had followed his parents’ advice to enroll 

in college after high school, but he did not want to 
continue on to a bachelor’s degree. Javier planned to 
enter the workforce as soon as he got his associate’s 
degree. His adviser talked with him about the bigger 
picture of higher education and careers, but Javier felt 
completely burned out on school. 


Although Javier was not interested in many of his 
classes, he was highly motivated by the MetroCard 
incentive and always made sure to meet the 
minimum requirements to receive it. He enrolled full 
time, attended advising as required, met with the 
career and employment specialist each semester, 
and attended tutoring for his developmental 
courses. His adviser said that these benchmarks, 
linked to receipt of the MetroCard, were the only 
things keeping him on track academically. Javier 
himself even admitted he could have used more 
motivation in school. 


Javier received his associate’s degree at the end of 
his third year, exactly on track with ASAP’s deadline. 
He then entered the workforce. 


Source: Scrivener et al. (2015) 


Institutions should give careful consideration 
to how they describe and promote both 
financial and non-financial incentives 
designed to encourage students to take 
advantage of available supports and 

services. Ideally, there will be a sense of 
mutual responsibility, in that the college or 
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program is providing something that benefits 
students, who in turn commit to particular 
actions to earn the incentive. Framing 
incentives as a reciprocal transaction is 

one way to demonstrate and encourage 
mutual responsibility. 


Institutions should prioritize positive 
incentives over penalties; that is, “carrots” 
over “sticks.” Penalties such as registration 
holds could lead to decreased student 
retention because they present an additional 
roadblock to registering for courses. These 
holds could also discourage a student from 
communicating with their advisor, thereby 
creating a missed opportunity for an advisor 
to help a student work through academic 
and/or non-academic challenges that might 
be part of an underlying problem affecting 
their success. 


Incentivize face-to-face advising meetings. 


Students can find face-to-face meetings 

with their advisors, held in-person or by 
videoconference, to be more helpful than 
emails or texts for receiving support and 
encouragement. Face-to-face meetings can 
also be more productive for working through 
complex activities such as goal-setting, 
selecting a course of study over multiple 
semesters, and discussing academic and 
career goals.’ 


Incentivizing face-to-face advising meetings 
could lead to advisor-student relationships 
that are more personalized. As an advisor 
learns about the challenges their students 
face, they could be better positioned to 
connect students with supportive services. 
In turn, students could come to view the 
advisor-student relationship as beneficial, 
which could be engaging and sustain a 
relationship throughout a student’s 
college experience. 


The Opening Doors program at Lorain 
County Community College offers an example 
of a financial incentive that encouraged 
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students to meet with their advisors face-to- 
face. Students participating in that program 
were eligible for a $150 stipend per semester 
for two semesters, which they could use for 
any purpose. The aim of the stipend was 

to promote contact between students and 
their advisor. The stipend was paid in two 
installments each semester, after scheduled 
counseling meetings were completed.** 
Another example is the Adelante 
performance-based scholarship program, 
which was designed to support low-income 
Latino men at Pima Community College in 
Tucson, Arizona. The program provided 
students with up to $4,500 in funding 

over three semesters, contingent on their 
meeting specific academic benchmarks and 
actively participating in advising, tutoring, 
and workshops."* 


Though face-to-face interactions might 

be preferred for in-depth discussions, 
advisors could find it efficient and effective 
to use technology to accomplish advising- 
related administrative tasks, such as 
registering students for courses, entering 
personal information into an information 
management system, or tracking key dates 
and deadlines each semester, that do not 
require direct advisor-student contact. The 
Key Communities program, implemented 
at a public university in Colorado, used an 
early alert system for grade and performance 
feedback."*° For these administrative tasks, 


face-to-face interaction could be less essential. 


Use a positive, student-centered 
approach before, during, and after 
advisor-student contacts. 


A central goal of advising is to provide 
positive experiences, built upon relationships 
that enable an advisor to understand the 
needs of individual students, in order to help 
them overcome barriers to success. When 
advisors, administrators, faculty, and staff 
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use a positive, student-centered approach to 
advertising, delivering, and following up on 
supports, students could be more inclined to 
view those supports as helpful or worthwhile. 
In turn, they could be self-motivated to 
continue to engage with their advisor and 
other support providers they view as invested 
in their success. This could help counter the 
impression students sometimes have that 
advisors are merely gatekeepers to course 
selection and registration. 


Positive, welcoming messages that are 
culturally responsive can be woven 
throughout students’ experiences in 
comprehensive, integrated advising 
programs. For example, the Adelante 
Scholarship Program sent students messages 
that conveyed that they could be successful 
in college, that validated their experiences 

as Latino men, and that reinforced the 
Adelante program group identity.”° Similarly, 
encouraging messages were an important 
focus of the Key Communities program, 
where advisors and staff first frontloaded 
information about high expectations and 
messages of belonging during a 2-day 
program orientation, and later continued to 
introduce students to faculty, staff, and peers 
to foster a sense of community that could 
support students throughout the program.’ 


Strengths-based advising can help increase 
students’ confidence and motivation to 
achieve and persist in college. This involves 
having advisors identify and build on 
students’ inherent skills and qualities in 
ways that help them develop and apply their 
strengths to new challenges and tasks."* 
Emphasizing students’ strengths, as opposed 
to weaknesses or deficits, can facilitate 
advisor-student relationships and increase 
students’ levels of engagement and academic 
self-efficacy.*° 
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4. Consider incentives that extend beyond 
advising activities to include other 
milestones required for students to 
progress in college. 


The panel recommends tying incentives 
not only to advisor-student contacts, but 
also to key activities that could ensure 
students are successfully progressing in 
college, such as using tutoring services or 
career services; enrolling in a minimum 
number of credit hours; and meeting grade 
point average (GPA) requirements.° 


Students participating in the Ohio ASAP 
Replication Demonstration, a program 
targeting low-income, nontraditional 
students at three Ohio community colleges, 
were eligible to receive a $50 incentive 
each month contingent on participation in 
advising, tutoring, and career services."! 

In the Learning Communities initiative at 


Kingsborough Community College, students 


in learning communities received a book 
voucher as an incentive to enroll in short 
courses offered between the fall and spring 
semesters, giving them access to even more 
credits in their first year.’ 
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Adelante Scholarship Program participants 
were eligible for awards of up to $1,500 per 
semester, for a total of three semesters, for 
completing a range of program requirements. 
A sample list of requirements and payment 
schedule for Adelante participants appears 
in Figure 4.2. The award was paid directly 
to students in three payments each semester. 
The first two payments were contingent 

on students attending an orientation and 
meeting with an advisor twice during the 
semester and on being enrolled in six or 
more credits. The third payment could 

vary in amount depending on the 
combination of benchmarks for academic 
performance and service participation 
completed by students, as verified through 
the college’s electronic service use databases, 
students’ activity books, and academic 
workshop sign-in sheets.'* 
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Figure 4.2. Sample list of requirements and payment schedule for awardees 


How do |! earn my Adelante Award? Requirements and Payment Schedules 


Orientation 
At the beginning of the semester, review program components, meet 
students and sign up for advising sessions. 


Required 


Enrolled in 6 or more credits at orientation date 


Required 


Initial Payment: For completing Adelante orientation. Students must be 
enrolled in 6 or more credits at the time of orientation. 


$150 


First Individual Advising Session 
Within the first half of the semester to discuss the student’s plans and 
challenges, and to recommend and sign up for tutoring and workshops. 


Required 


Second Individual Advising Session 

Within the second half of the semester discuss the student’s academic 
progress and challenges, progress in attending tutoring and workshops, 
and to prepare for spring registration. 


Required 


Enrolled in 6 or more credits at census date (10/5/12) 


Required 


Midterm Payment 

For completing both advising sessions. 

Students must be enrolled in 6 or more credit hours at the census 
(10/5/12) in order to receive midterm payment at time of the 2nd advising 
session. If a student does not meet this enrollment requirement, but 
enrolls in late-start classes after the census, then the $150 will be mailed 
to them. 


$150 


Services 

Participation in a certain number of Platicas, tutoring sessions and 
workshops is required; Advisors and students work together to determine 
breakdown of remaining flexible contacts 


| 
4 Total Required 
(breakdown below) 


6 Total Required 
(breakdown below) 


Platicas 
Facilitated peer discussion group on Latino issues 


1 required 


1 required 


Tutoring Sessions 
Visit a Learning/Tutoring center; tutoring can be completed in % or full- 
hour sessions. 


1 hour required 


1 hour required 


Academic Workshops 
Facilitated workshops on a variety of student success topics; selected 
jointly by advisor and student to best meet students’ needs. 


1 required 


1 required 


Flexible Contacts 

Students will work with their advisors to determine the best combination 
of additional tutoring, workshops, or Platicas to best meet students’ 
needs. 


Note 1 hour of tutoring equals 1 contact 


1 required 


3 required 


Final Service Payment: For meeting all service requirements above 


Academic Performance Award: Based on earning a “C” grade or better 
in a minimun number of credit hours. “P” grades are eligible, but 
grades are not eligible. 


ce 


* The Services Award is not dependent on full or part time status. Students can earn either award. 


Source: Patel & Valenzuela (2013). 


$100* 


Part-Time: 
Between a 6-11 
credits with a “C” or 

better 


Part-time Student — 


$200* 


Full-Time: 
12 or more credits 
with a “C” or better 


Full-time Student 
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The Vision Inspired Scholarship through 
Academic Achievement (VISTA) scholarship 
program provided up to $1,000 in additional 
financial aid in each of four consecutive 
semesters contingent upon students meeting 
with their advisors at least two times 

per semester.'* This aid was awarded in 
increments tied to academic milestones, and 
payments were made directly to students. 
The program provided cash payments to 
students who enrolled in at least 12 credit 
hours in their first semester, in at least 15 
credit hours in subsequent semesters, and 
earned a GPA of 2.0 or higher. 


Potential Obstacles and the 
Panel’s Advice 


OBSTACLE: Institutions might lack the resources 
to pay for and administer financial incentives. 


PANEL’S ADVICE: Incentives can require 
additional resources that institutions do not have 
readily available. Institutions could consider 
redirecting funds from activities without clear 
evidence of effectiveness in improving student 
outcomes to new, evidence-based interventions 
designed to directly serve students. Institutions 
might also consider directing whatever short- 
term investments in incentives they can make 
toward activities designed to foster high-quality 
initial advisor-student interactions, with the 
expectation that students will see the value in 
advising and engage without ongoing 

financial support. 


Non-financial incentives can also be an effective 
way to encourage students to engage with their 
advisors. Examples include priority registration; 
priority appointments with staff providing 

other support services, such as financial aid; 
priority parking; vouchers to the bookstore or 
cafeteria; tickets to a campus event; work-study 
opportunities; and letters of recommendation for 
internships. Colleges might also consider asking 
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students what types of incentives are of value to 
them, as students might offer novel suggestions 
that are non-monetary. 


Some institutions have even offered discounted 
tuition as an incentive for students to participate 
in advising as they progress toward completing 
their degree requirements. One model enables 
students to “buy one course, get the second 
course free” during summer months, conditional 
on meeting advising objectives. This can 
potentially be accomplished cost-effectively 
simply by filling in seats in summer course 
sections that typically run at half capacity, 
thereby not adding to an institution’s financial 
costs. For example, CUNY has offered a Buy One, 
Get One Free (BOGO) waiver that offers students 
the opportunity to complete two summer 
courses, with the lower-cost course tuition free.” 


OBSTACLE: Incentives could have unintended 
consequences if they are not administered equitably. 


PANEL’S ADVICE: When designing incentives to 
promote advisor-student contact, it is important 
for institutions to avoid unintended inequities. 
For instance, if only select students are eligible 
for an incentive, then ineligible students or those 
unable to meet the incentive requirements could 
be discouraged from engaging with their advisor. 
Positive incentives should be integrated into 
advising models in ways that consider potential 
barriers students could be facing, as well. In- 
person meetings, for example, should not be 
required if advising is offered only during the 
day and the student population includes working 
students who attend class at night. 


OBSTACLE: Administering incentives can distract 
advisors from their core advising functions. 


PANEL’S ADVICE: It is possible that some 
advisors involved in administering incentives 
could feel more responsible for monitoring 
students’ compliance with program requirements 
tied to the incentive payments than for taking 
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advantage of the extra opportunities to provide 
students with guidance. For example, an 
evaluation of the Opening Doors program in 
Louisiana found advisors working with the 
program participants sometimes spent more time 
monitoring compliance than they did advising 
them on courses or helping them address non- 
academic problems."° 


To the extent feasible, the panel suggests 
institutions should consider automating the 
monitoring process. Relatedly, colleges should 
also reinforce the importance of student 
engagement and measure that engagement, 
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not simply the benchmarks required to meet 
an incentive. This might include collecting 
information on how the advisors help 

students beyond the incentive requirements. 
These changes might require adopting and 
implementing a culture of support. It also might 
take time for institutions to shift away from a 
“check the box” culture of advising to one that 
encourages students to be more engaged with 
their advisors as well as with the academic and 
non-academic supports students are connected 
to through advising. 
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A 


academic supports refer to academic advising, tutoring, textbook lending, additional study sessions, 
and instructional support in math/writing, among others. 


advisor/advising is a collaborative process between a student (“advisee”) and an advisor designed to 
help the student realize their educational potential and their academic goals. 


advising leadership refers to any person who is in a position of authority or who manages advising 
staff, practices, procedures, and policies at a postsecondary institution. 


C 


career and employment services refer to assistance with employment and career development, 
including employment workshops, career exploration, career navigation, resume workshops, mock 
interviews, alumni network events, and assistance with job or internship placements. 


coach/coaching refers to a structured learning process facilitated by a trained coach. The coach 
uses active listening, questioning, feedback, and goal-setting techniques to help students develop 
new perspectives, strategies, and skills that help them reach their educational, personal, and 
professional goals. 


comprehensive, integrated advising refers to advising that is intentionally designed to incorporate 
and connect students with a broad range of relevant academic and non-academic supports, including 
instructional support, counseling, mentoring and coaching, and career services, among others. 


counselor refers to a mental health specialist who provides mental health support to students. 
Advisors and career support staff are sometimes referred to as “counselors” or “career counselors.” 


D 


developmental education courses are designed to develop the reading, writing, or math skills of 
students who are deemed—often through standardized tests—underprepared for college-level courses. 
Developmental education courses, which are sometimes called “remedial” education courses, are 
typically not credit bearing. 


E 


early-alert system refers to an online administrative system that monitors student academic 
progression and performance, detects individual students falling behind, and notifies student support 
staff and/or faculty. Early alert systems facilitate detection of and proactive responses to students in 
need of academic and non-academic supports. 


enhanced advising replaces the quick, transactional structure of traditional advising with a more 
holistic structure in which advisors ask deeper questions and engage more with students to help them 
succeed. (Compare with traditional advising.) 
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F 


faculty refers to any person who teaches full- or part-time at the postsecondary level. This includes 
instructors and adjunct professors; it can also include graduate students and other staff responsible for 
teaching courses. 


financial advising and support includes tuition support; support for other education-related 
expenses, including books, fees for certification exams, work boots, or uniforms; funds for 
transportation or childcare; and guidance on how to identify and access external funding 
opportunities, such as Pell grants and other types of financial aid. 


flipped advising refers to a model where students engage in preparatory advising activities, such as 
online modules and exercises, prior to and between meetings with the advisor. This allows the advisor 
to focus on more essential aspects of academic and career planning during advising sessions. 


G 


group design study refers to research that includes an intervention group and one or more 
comparison groups. Examples include randomized controlled trials (RCTs) and quasi-experimental 
design studies (QEDs). 


H 


hidden curriculum refers to the unwritten, unofficial lessons, values, and perspectives that students 
are expected to learn in school. In postsecondary settings, this can include things such as the 
importance of seeking opportunities to network with faculty members or to visit career services to 
seek an internship in the first few years of college. First-generation college students frequently are not 
aware of these unwritten tips and tricks and can benefit most from explicit exposure to them. 


historically underserved students are the category of students not considered when U.S. education 
systems were originally designed. Examples include students of first-generation immigrants, from 
low-income families, of adult status, of color, of marginalized gender identities, from second-language 
backgrounds, of undocumented status, with military service, with disabilities, with dependents, in 
foster care, or with a record of incarceration. 


holistic student support provides all students with the types and intensities of information, 
services, and resources they need to identify, select, and progress on the best pathway toward 
achieving their educational and career goals. Holistic student support meets students where they are 
developmentally, addresses their individual needs, leverages their strengths, and focuses on student 
learning and development. 


I 


incentives are encouragements to take up services or complete tasks. Financial incentives include 
gift cards, book vouchers, transportation passes, parking permits, food, or subsidized childcare; non- 
financial incentives include priority registration, priority meeting times with advisors, and access to 
additional courses at no cost. 
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L 


learning management system is a software application used by staff and faculty in postsecondary 
education to deliver academic and non-academic content and resources, as well as to track students’ 
progress, activities, and performance. 


M 


mentor/mentoring refers to a supportive learning relationship between a student and a mentor. The 
mentor, who might be a student peer, faculty member, or professional, provides support, guidance, 
and an informal role model to the student (“mentee”). 


meta-analysis is a quantitative statistical analysis of several separate but similar experiments or 
studies in order to test the pooled data for statistical significance. 


N 


non-academic supports include supports outside of the classroom, such as career development and 
long-term academic planning. They can also include basic needs supports, such as assistance with 
life challenges (e.g., family or work obligations, food security, housing issues, transportation, and 
childcare) that are interfering with a student’s academic progress. 


P 


predictive analytics describes a wide range of statistical techniques that include data mining, 
machine learning, and predictive modeling that analyze existing data to make predictions about future 
events and trends, including the likelihood of a student’s success. 


proactive advising refers to a model where advisors anticipate and continuously engage students. 
The primary goal is to develop a caring and beneficial relationship that increases students’ academic 
motivation and persistence and helps “catch” students before they encounter barriers that hinder their 
academic progress. Sometimes referred to as “intrusive” advising. 


S 


strengths-based advising refers to a model where advisors identify and build on the inherent talents 
students bring with them into college, teaching students to develop and apply their strengths to new 
and challenging learning tasks. 


student-centered advising focuses less on advisors passing on information and advice and more on 
advisors coaching students to develop attitudes, skills, and behaviors as learners, decisionmakers, and 
community participants, with success measured in terms of learner outcomes. 


student support staff refers to any person at a postsecondary institution who provides direct 
assistance to students, including advisors, mentors, career counselors, tutors, and financial aid staff, 
among others. 
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T 


tailored advising refers to advising that is personalized to the individual academic, personal, 
professional, and career needs and goals of the student. 


traditional advising refers to advising focused on class schedules, degree requirements, and financial 
aid procedures. Compare to enhanced advising. 


tutor/tutoring is instructional support provided by a tutor that helps students develop learning 
strategies and improve their academic performance. Tutoring can be implemented in a one-on-one or 
group format. 
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What Is a Practice Guide? 


The What Works Clearinghouse™ (WWC) within the Institute of Education Sciences (IES) publishes 
practice guides to share expert recommendations addressing a key education challenge. Each 
recommendation in the practice guides is explicitly connected to supporting evidence from studies that 
meet WWC standards. 


How Are Practice Guides Developed? 


To produce a practice guide, IES first selects a topic based on the needs of the field. Next, working 
with a WWC contractor, IES selects a panel chair who is a national expert on the topic and panelists to 
co-author the guide. Panelists are selected based on their expertise in the field and the belief that they 
can work together to develop relevant, evidence-based recommendations. Panels include at least two 
current educators who are actively working in the field. 


The WWC contractor conducts a systematic literature search and consults with the panel to identify 
relevant research studies. These studies are then reviewed using WWC design standards by the WWC 
contractor who assesses the internal validity of each study.” The panel synthesizes the studies that 
meet WWC standards into recommendations. The panel works with the WWC contractor to draft the 
practice guide. 


The practice guide is then peer reviewed. This review is independent of the panel and the federal and 
contractor staff who supported the development of the guide. A critical task of the peer reviewers is 

to determine whether the evidence cited in support of each recommendation is up to date and that 
studies of similar or better quality with contradictory results have not been overlooked. Peer reviewers 
also evaluate whether the level of evidence category assigned to each recommendation is appropriate. 
The WWC contractor revises the guide to address concerns identified by the external peer reviewers 
and IES. 


Levels of Evidence for What Works Clearinghouse Practice Guides 


The level of evidence represents the quality and quantity of existing research supporting each 
recommendation. The panel assigns each recommendation one of the following three levels of 
evidence: strong evidence, moderate evidence, and minimal evidence. 


A strong level of evidence rating refers to evidence from more than one well-designed, well- 
implemented experimental study that the recommended practices improve relevant outcomes for the 
population of students relevant to the practice guide. In other words, this level of evidence indicates 
that there is strong causal and generalizable evidence to support the panel’s recommendation. 


A moderate level of evidence rating refers either to evidence from well-designed, well-implemented 
quasi-experimental design studies, studies where the sample does not represent the population of 
students relevant to the practice guide, or only one well-designed, well-implemented experimental 
study. In other words, this level of evidence indicates that the relevant research may not be 
generalizable or that the WWC has some reservations about the quality of the research for causal 
inferences because of the design or implementation of the studies. 
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A minimal level of evidence rating suggests that the panel and the WWC cannot point to a body of 
evidence that demonstrates the practice’s positive (or potentially positive) effects on student outcomes. 
In some cases, this simply means that the recommended practices would be difficult to study using 

an experimental or quasi-experimental research design; in other cases, it means that researchers 

have not yet studied the practice, or that there is a lack of evidence or conflicting evidence about its 
effectiveness. A minimal evidence rating does not indicate that the panel views the recommendation as 
any less important than other recommendations with strong or moderate evidence ratings. 


To determine these evidence ratings, the panelists first conduct a careful review of the studies 
supporting each recommendation. For each recommendation, they examine the entire evidence base, 
taking into account the following considerations: 


¢ The extent of evidence meeting WWC standards. 


¢ The weighted mean effect size from the fixed-effects meta-analysis for each relevant outcome 
domain, including its sign and statistical significance.* 


¢ How well the studies represent the range of participants, settings, and outcomes relevant to the 
recommendation. 


e Whether findings from the studies can be attributed to the recommended practice. 
¢ The panel’s confidence in the effectiveness of the recommended practice. 


The panel determines the level of evidence rating for a recommendation based on each of the criteria 
in Table A.1. For a recommendation to get a strong rating, the research must be rated strong on each 
criterion. If at least one criterion receives a rating of moderate and none receives a rating of minimal, 
then the level of evidence for the recommendation is determined to be moderate. If one or more 
criteria receive a rating of minimal, then the level of evidence for the recommendation is determined 
to be minimal. 
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Table A.1. IES levels of evidence for What Works Clearinghouse practice guides 


CRITERIA 


outcomes"? 


Relevance to 
scope 


Relationship 
between 
research and the 
recommendation 


STRONG 
Evidence Base 


Extent of evidence | The research includes 


two or more studies that 
meet WWC standards. 
The studies include 
-more than one setting 
and a sample of more 
_ than 350 individuals. 


Effects on relevant For at least half of the 


_ key outcome domains'™ 

_with findings meeting 

_WWC standards, the 
following conditions 

are met: 

/ 


_* The mean effect 
from a fixed-effects 
meta-analysis‘ is 
statistically significant 
and positive; AND 


¢ More than 50.0 
percent of the 
fixed-effects meta- 
analytic weight 
comes from studies 
that Meet WWC 
Standards Without 
Reservations. 


The mean effect 
from a fixed-effects 
_meta-analysis is not 
Statistically significant 
_and negative for any 
key outcome domain 
_relevant for the 
recommendation. 


MODERATE 
=AYACe(=Yalexe Wl =t- [1-1 


The research includes at least 
one study that meets WWC 
standards. The study or studies 
either includes only one setting 
or a sample of fewer than 350 
individuals. 


For at least half of the key outcome For over half of the key 


domains with findings meeting 
WWC standards, the following 
conditions are met: 


* The mean effect froma 
fixed-effects meta-analysis 
is statistically significant and 
positive; AND 


¢ More than 50.0 percent of the 
fixed-effects meta-analytic 
weight comes from studies that 
Meet WWC Standards With 
Reservations. 


Contradictory evidence from a 
fixed-effects meta-analysis that 

is statistically significant and 
negative is considered with regard 
to relevance to the scope of the 
recommendation. 


MINIMAL 
SAYA Ce (=Y a vere =t- [1:1 


The research does not 
include at least one study 
that meets WWC standards. 


outcome domains with 
findings meeting WWC 
standards, at least one of the 
following conditions is met: | 


« The mean effect 
from a fixed-effects 
meta-analysis is NOT 
statistically significant and 
positive; OR 


« No studies meet WWC 
standards. 


The research has 
direct relevance to 
_scope—relevant 
settings, populations, 
_comparisons, and 
outcomes evaluated. 


_ The recommendation 
is directly tested or the 
recommendation is a 
major component of the 
interventions evaluated 
in at least half of the 
studies. 


_ The recommendation is directly 


Relevance to scope may vary. At 


least some research is directly 
relevant to scope. 


tested or the recommendation 
is a major component of the 
interventions evaluated in less 
than half of the studies. 


No research relevant 


to the scope of the 
recommendation could be 
located. 


The recommendation is not 
tested in the studies, and the | 
panel provides references to © 
one or more peer-reviewed 
publications that expound 
theories that support the 

recommendation. | 
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MINIMAL 
SAYA Ce(=¥ a (exe =t- [1:1 


Panel confidence 


Role of expert 
opinion 


When assessment 
is the focus of the 
recommendation 


Overall level of 
evidence 


The panel has a high 
degree of confidence 
that a given practice is 
effective. 


Panel may not be confident 

about whether the research has 
effectively controlled for other 
explanations or whether the 
practice would be effective in most 
or all contexts. 


In the panel’s opinion, the 
recommendation must be 
addressed as part of the 
practice guide; however, the 
panel cannot point to a body 
of research that rises to the 
level of moderate or strong. 


Not applicable. 


Not applicable. 


The recommendation reflects 
expert opinion based on 
reasonable extrapolations of 
research. 


For assessments, 
research meets 

the standards of 

The Standards for 
Educational and 
Psychological Testing.'° 


For assessments, research 
provides evidence of reliability 
that meets The Standards for 
Educational and Psychological 
Testing, but samples may 

not adequately represent 

the population on which the 
recommendation is focused. 


Not applicable. 


A recommendation 
satisfies a “strong” 
level of evidence for all 


applicable criteria above. 


A recommendation satisfies a 
“moderate” level of evidence for 
at least one applicable criterion 
above, and no criterion has a 
“minimal” level of evidence. 


A recommendation satisfies 
a “minimal” level of evidence 
for at least one applicable 
criterion above, and all 
applicable criteria have at 
least a “minimal” level of 
evidence. 


A Final Note About WWC Practice Guides 


Expert panels try to build a consensus, forging statements that all their members endorse. Practice 
guides do more than find common ground; they create a list of actionable recommendations. Where 
research clearly shows which practices are effective, the panelists use this evidence to guide their 
recommendations. However, in some cases, research does not provide a clear indication of what 
works. In these cases, the panelists’ interpretation of the existing, but incomplete, evidence plays an 
important role in developing the recommendations. 
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Practice Guide 


Phase 1: Selecting the Panel; Establishing a Review Protocol 


Expert Panel. The WWC established a six-member expert panel to advise on the development of the 
practice guide. The panel consisted of researchers who were at the forefront of postsecondary advising 
research and practitioners with experience in implementing postsecondary advising interventions. 


Practice Guide Review Protocol. The WWC worked with the expert panel to develop the practice guide 
review protocol, available at https://ies.ed.gov/ncee/wwc/Document/1293, which clarifies the 
practice guide’s purpose and scope. Five questions were identified to guide the literature search and 
the evidence review effort: 


¢ Which advising interventions are effective at helping students progress and persist in college? 
¢ Which advising interventions are effective at helping students improve academic achievement? 
¢ Which advising interventions are effective at helping students complete their degree? 


¢ Which advising interventions are effective at helping students improve their post-graduation 
educational and employment outcomes (e.g., earnings, wage, and graduate program enrollment)? 


¢ Which advising interventions are particularly effective for certain subgroups of students 
(including first-generation college students, women, underrepresented minorities, academically 
underprepared students, students from low socioeconomic status backgrounds, returning students, 
and/or transfer students)? 


The timeframe for the literature search was approximately 20 years, from January 1999 to December 
2019. The eligible sample included postsecondary students in the United States or Canada. Eligible 
study designs included randomized controlled trials (RCTs) and quasi-experimental design studies 
(QEDs). Studies had to include an advising intervention with a primary focus on improving student 
outcomes during or after college. Only outcomes that fit into one of five outcome domains addressing 
postsecondary student outcomes were eligible for inclusion. The five domains were: 


1. Progressing in college 

2. Academic achievement 

3. Postsecondary degree attainment 
4. Credential attainment 

5. Post-graduation outcomes 


For additional details, the protocol can be accessed on the What Works Clearinghouse website.' 
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Phase 2: Literature Search and Review 


A targeted yet comprehensive search of electronic databases was conducted using keywords focused 
on eligible advising intervention components, population, setting, study design, and outcomes. Panel 
members also recommended studies that could potentially contribute to the guide. 


A total of more than 18,000 records were identified and screened using a multi-stage screening process 
to determine whether they focused on advising interventions and met the eligibility criteria detailed 

in the protocol (i.e., eligible advising interventions, population, setting, study design, and outcomes). 
This screening process resulted in 168 eligible studies that were reviewed using WWC 4.0 group design 
standards." For a study to meet WWC standards, at least one contrast must meet standards with 

or without reservations. See Figure B.1. for the number of records that went through the screening 
and eligibility processes and the number of studies that were reviewed and included as supporting 
evidence in the practice guide with the corresponding WWC evidence ratings. 


Figure B.1. Studies identified, screened, and reviewed for this practice guide 


Records identified 


Ko f=Yalaicersiateyal 


(n=18,122) 
Records screened in for Records excluded 
topic relevance (n=498) (n=17,624) 
AeA Records eligible for review Records ineligible for review 
<a 
iifetleyi fing (n=168) (n=331) 
Studies that meet WWC Studies that do not meet 
Evidence Rating Standards without WWC Standards (n=128) 
reservations (n=16) 
—<——=====) Studies that meet 
Studies that meet WWC WWC Standards, but 
Standards with reservations are not relevant to the 
(n=5) recommendations (n=19) 
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Phase 3: Generating the Recommendations 


WWC staff conducted a detailed examination of the 40 studies that meet WWC standards to identify 
practices that played a role in each intervention. In conjunction with the WWC, the panel identified 
four recommendations that were grounded in evidence provided by 21 of the 40 studies that meet 
WWC standards. All studies relevant to a recommendation were included in the practice guide, even 
if they did not provide statistically significant evidence of positive impacts."° The remaining 19 studies 
that meet WWC standards did not provide evidence relevant to the four recommendations identified 
by the panel.'* After drafting the evidence-based recommendations, the panel suggested ideas for 
carrying out the recommendations. 


Phase 4: Drafting the Practice Guide 


WWC staff worked with the panel to further expand and clarify each recommendation and delineate 
how to implement each recommendation. WWC staff then used an iterative process to draft the 
recommendations, soliciting feedback from the panel and revising as needed at each stage. WWC staff 
also compiled the level of evidence for each recommendation and drafted the technical appendices. 
The practice guide underwent several rounds of review, including IES external peer review (as 
described in Appendix A). 
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Conducting Reviews of Eligible Studies 


WWC-certified staff reviewed 40 studies to assess the quality of evidence supporting education 
programs and practices, using WWC group design standards version 4.0. Of these 40 studies, 21 
provide the evidence for the recommendations in this practice guide. These 21 studies are bolded in 
the Notes and the References sections. Reviews of all 40 individual studies reviewed for this practice 
guide are available on the What Works Clearinghouse website at https://ies.ed.gov/ncee/wwc/ 
ReviewedStudies/Index#/ProductId:XXX. 


Determining Relevance to Recommendations 


About half of the 21 studies provide evidence for more than one recommendation, as the interventions 
in these studies include more than one practice (or component) for improving student outcomes. For 
example, one multi-component intervention might include comprehensive and integrated advising 
(Recommendation 1); sustained, personalized advising relationships (Recommendation 2); and 
mentoring or coaching (Recommendation 3) and thus provide evidence for three recommendations in 
this guide. 


It is not possible to identify whether one particular component or a combination of components within 
a multi-component intervention produced an effect. Thus, the calculated effect sizes reflect the effect 
of each full intervention package. The project staff assessed which components were likely to cause an 
effect based on their prominence in the intervention program. Major intervention components in each 
study that meets standards were then assigned to the evidence base for the relevant recommendation. 
In Table C.1, the mapping between each study and the four recommendations is presented. Table C.1 
also indicates which studies include large samples, that is 350 or more participants, and which were 
conducted in multiple settings. Eight of the 21 studies include large samples and were conducted in 
multiple settings, six studies only include large samples. All studies that included multiple settings also 
included a large sample. 


Table C.1. Mapping between studies and recommendations 


Sample Size 
Valo met-1ailale) Recommendation 
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= 
ge | 3 
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Bettinger & Baker (2014) e e e e 
Binder et al. (2015) ° ° e 
Brock & Richburg-Hayes (2006) e e e 
Campbell & Campbell (2007) e e 
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Sample Size 
Valo met-1iilale) Recommendation 
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Dennehy & Dasgupta (2017) e 
Hodara et al. (2017) e e e 
Kim et al. (2013) e 
Lavallais (2017) e 
Maton et al. (2000) e e e 
Mayer et al. (2019) e e e e 
Medina (2016) e e 
Miller et al. (2020) e e e e e 
Nosaka & Novak (2014) e e e e 
Oreopoulos & Petronijevic (2018) e ° e 
Patel & Valenzuela (2013) e ° e e 
Scrivener & Weiss (2009) e e e e 
Scrivener et al. (2015) e e e e e 
Scrivener et al. (2018) e ° e 
Servies (1999) e 
Sundy (2017) e 
Thomas (2005) e 
4A study with a large sample includes 350 or more participants. 


Determining Relevant Outcomes 


To simplify and focus the synthesis of evidence, the WWC worked with the panel to identify 

which of five outcome domains are relevant for each recommendation. The domains are listed 

in Table C.2. All five outcome domains are relevant to all four recommendations, as one might 
reasonably expect that the practices embedded in each recommendation could potentially improve 
outcomes in each domain. However, no studies that meet WWC standards and are relevant toa 
recommendation included findings in either the credential attainment or post-graduation 
outcomes domains. 


The panel and staff considered only the findings in the predetermined relevant domains when 
determining the level of evidence for each recommendation. For brevity, only findings in relevant 
domains are presented in this appendix. 
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Table C.2. Relevant domains for each recommendation 


Recommendations 1-4 


Progressing in college 

Academic achievement 
Postsecondary degree attainment 
Credential attainment 
Post-graduation outcomes 


Sa Se 


Estimating Fixed-Effects Meta-Analytic Effect Sizes 


As discussed in Appendix A, the level of evidence determination for each recommendation relied on 
the extent of the evidence from the supporting studies. To synthesize the evidence across studies for 
each recommendation, the WWC calculated a weighted fixed-effects meta-analytic mean effect size 
for each relevant outcome domain in which at least two studies had findings.’ This pooled estimate, 
which treats all of the studies contributing to that practice recommendation together as a single study, 
means the WWC did not rely on a “vote counting” approach to assess evidence of positive effects on 
any relevant outcome. For domains in which only one study had findings, the study’s domain-level 
effect size was used in the level of evidence determination. To calculate the meta-analytic weight, 
studies were weighted by the inverse of the variance of each study’s effect size. Thus, large-scale 
studies received more weight than small-scale studies. The statistical significance of each effect size for 
each outcome domain was calculated using a z-test. By pooling samples across studies, meta-analytic 
mean effect sizes can have greater precision than their component study-level effect sizes. Several 
studies with imprecisely estimated non-significant positive effects can be synthesized into a precisely 
estimated significant positive meta-analytic mean effect. For additional information on this process, 
see appendix H of the WWC Version 4.1 Procedures Handbook. 


To ensure that the resulting effect sizes were statistically independent, only one contrast from each 
study was included in the analysis."* In the case of multiple-contrast studies, only the findings from 
the contrast most relevant to the recommendation were included in the meta-analytic effect size 
calculation. Relevant contrasts that compared the effectiveness of two interventions were excluded 
from the meta-analysis. 


For consistency, the meta-analytic effect size calculation for each domain is based on outcomes 
measured closest to the end of the intervention, with exceptions for specific domains. The effect 
sizes for the domains for each recommendation are listed in Tables C.4, C.6, C.8, and C.10. 
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Recommendation 1: Intentionally design and deliver comprehensive, 
integrated advising that incorporates academic and non-academic 
supports to empower students to reach their educational goals. 


Rationale for Recommendation 1 Level of Evidence: Moderate 


WWC staff and the expert panel assigned Recommendation 1 a moderate level of evidence, based on 
eight studies of comprehensive, integrated advising interventions. Four of the studies'°° meet WWC 

group design standards without reservations, and the other four studies’ meet WWC group design 

standards with reservations. 


Across the eight studies, there were findings in three outcome domains (Table C.3) even though all 
five outcome domains were relevant for this recommendation. All three domains had statistically 
significant, positive meta-analytic effect sizes: progressing in college (g = 0.23, p < .01), academic 
achievement (g = 0.26, p < .01), and postsecondary degree attainment (g = 0.39, p < .01). 


Table C.3. Domain-level effect sizes across the eight studies supporting Recommendation 1 


Number Mean Tob Oxo) ani(e(-Valer=) 
Domain of studies effect size Talk=yave-1| p-Value 
Progressing in college | 6 | 0.23 | 0.19, 0.26 | < 0.01 
Academic achievement | 5 0.26 0.21, 0.31. < 0.01 
Postsecondary degree attainment 3 0.39 | 0.33, 0.45 < 0.01 


Note: Significant findings are bolded. ns = nonsignificant findings. All effect sizes were calculated using a fixed effects meta- 
analytic effect size across studies. 


Evidence from the eight studies provides a direct test of the recommendation, as all interventions 
evaluated provide comprehensive and integrated advising. In Hodara et al. (2017), the intervention 
is acomprehensive community college scholarship and advising program that includes transportation 
assistance, emergency supports, summer orientation, a college success coach, college and career 
success courses, and transfer support. In Maton et al. (2000), the intervention includes financial 
aid, asummer bridge program, community-building activities, personal advising, counseling, 
mentorship, and tutoring and community service. In Miller et al. (2020), the intervention includes 
comprehensive advising, tutoring, financial support, course enrollment support, a full-time enrollment 
requirement, and holistic support from program staff. In Nosaka & Novak (2014), the intervention 

is a learning community that includes a summer orientation, integrated courses and a seminar, peer 
mentoring, an early alert system, a shared residence hall, and community-building events. In Patel & 
Valenzuela (2013), the intervention is a scholarship program that includes an orientation, advising, 
tutoring, academic workshops, and learning activities. In Scrivener et al. (2015), the intervention 
includes a full-time enrollment requirement, a dedicated advisor, support from a dedicated career 
and employment services staff member, dedicated tutoring services, course enrollment support, 

an optional study success seminar, and financial support in the form of tuition waivers, free public 
transportation, and free textbooks. In Scrivener et al. (2018), the intervention is a one-semester 
remedial program that includes intensive student-centered developmental coursework along 

with advising, tutoring, and a weekly college skills seminar. In Sundy (2017), the intervention is a 
comprehensive program that includes developmental classes, supplemental instruction, tutoring, 
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access to mathematics and writing specialists, career planning, course and major selection supported 
by individual advising sessions, academic progress monitoring, transfer planning, campus visits to 
4-year colleges, workshops, newsletters, social events, and cultural enrichment activities. 


The collection of studies demonstrates a medium to large extent of evidence and consistent 
positive effects. In all eight studies supporting this recommendation, interventions provide 
comprehensive and integrated advising. Therefore, the expert panel has assigned a moderate level 
of evidence to this recommendation. This rating is supported by the strength of the evidence 
according to the following criteria: 


¢ Extent of Evidence. Each outcome domain average is based on more than one study with a total 
sample size above 350. 


* Consistency of Effects on Relevant Outcomes. The average effect sizes for all three of the 
outcome domains (progressing in college, academic achievement, and postsecondary degree 
attainment) are positive and statistically significant. However, the average effect sizes for two of the 
positive outcome domains (progressing in college and academic achievement) are predominantly 
derived from studies that meet WWC group design standards with reservations. 


¢ Relationship between the Evidence and Recommendation. In all eight of the studies used to 
support Recommendation 1, the advising intervention is comprehensive and integrated. 


Table C.4. Studies providing evidence for Recommendation 1: Intentionally design and deliver 
comprehensive, integrated advising that incorporates academic and non-academic supports to empower 
students to reach their educational goals 


Participants? 


Evidence for Recommendation 1 


Talccdavcealiceyamexeyareliarey aby 


Comparison 
loxeyatelit(eya} 


Outcome Domain 
and WWC 
Calculated Effect 
Size 


Hodara et al. 
(2017) 


QED 


Meets WWC group 
design standards 
with reservations 


1,163 first-year 
students 


Large sample 


1 community 
college in 
Oregon 


Single 
setting 


Future Connect: 

Future Connect is 

a comprehensive 
scholarship and advising 
program for first- 
generation and low-income 
students entering their first 
year of community college. 


Relevant features 

include scholarships, 
transportation assistance, 
as-needed emergency and 
housing support, summer 
orientation, a college 
success coach, two 

free college and career 
success courses, transfer 
support, and optional 
leadership opportunities. 


Business- 
as-usual: 
Comparison 
group students 
had access to 
business-as- 
usual courses 
and services. 
Detailed 
information on 
the comparison 
condition was 
not included in 
the study. 


Progressing in 
college: 
g = 0.80* 


Academic 
achievement: 
g = 0.38* 


Postsecondary 
degree attainment: 
g = 0.36* 
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Participants? Tal e-Ya(-art(olamerelarelit(o) a hammmm exeyarelii(eya Size 
Maton et al. (2000) 155 Science, 1 public Meyerhoff Scholars Business-as- Academic 
Engineering, university in Program: The program usual: achievement: 
QED and Maryland is designed to Comparison g=0.42 
Mathematics ; increase the number group students 
aes tee = eg (SEM) students Single of underrepresented had access to 
See setting minority group members _ business-as- 
Small sample who pursue graduate and __ usual services. 
professional degrees in They are in 
science, engineering, the same SEM 
and math. courses as the 
intervention 
Relevant features group students. 
include financial aid, a 
summer bridge program, 
community-building 
activities, personal 
advising, counseling, and 
mentorship, tutoring, and 
community service. 
Miller et al. (2020) 1,501 low- 3 community Accelerated Study in Business-as- Progressing in 
income colleges in Associate Programs usual: college: 
RCT students (Pell Ohio (ASAP): The Ohio Comparison g = 0.34* 
rant eligible Programs model was roup students 
Megs WMG aiauy : alk Multiple ieee: to closely follow Re a to Postsecondary 
design standards Large sample _ settings the CUNY ASAP model to business-as- degree attainment: 


without reservations 


address multiple potential 
barriers to students 
completing community 
college within 3 years. 


Relevant features include 
comprehensive advising, 
tutoring, financial support, 
course enrollment support, 
full-time enrollment 
requirement, and holistic 
support from program staff. 


usual services 
that were less 
intensive and 
individualized 
than those which 
the intervention 
group received. 


g = 0.49* 
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Outcome Domain 
and WWC 
Calculated Effect 
Size 


Nosaka & Novak = 3,982 first-year 1 public Key Communities: Business- Progressing in 
(2014) students university in Students participate in a as-usual: college: 
Colorado Key learning community Comparison g = 0.22* 
QED Large sample ; that aims to fostera sense group students 
Single of community, academics, did not 
Meets WWC group settin ee Ae -~ ; 
i g leadership, diversity, participate in the 
design standards : 
: ; and service. program and 
with reservations 
had access to 
Relevant features include a pysiness-as- 
2-day summer orientation, sual courses 
integrated courses and and services. 
a Key seminar, peer Detailed 
mentoring, early alert information on 
system for grade and the comparison 
performance feedback, @ — condition was 
shared residence hall, and pot included in 
community-building events. the study. 
Patel & Valenzuela 1,028 male 1 community Adelante Scholarship Business-as- Progressing in 
(2013) Hispanic college in Program: The Adelante usual: college: 
students, most Arizona program is a performance- Comparison g =0.17* 
RCT low-income ; based scholarship program group students 
Meets WWC group (Pel! grant Single in which students receive hadaccessto Academic 
: one eligible) setting scholarships and other business-as- achievement: 
design standards : ‘ = -0.05 
Cr OUPScoe none support contingent upon — usual services 9 : 
Large sample academic progress and and financial 
achievement in college. aid. 


Relevant features include 
an orientation, advising, 
tutoring, academic 
workshops, and learning 
activities. 
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Outcome Domain 
and WWC 
Calculated Effect 
Size 


Scrivener et al. 
(2015) 


RCT 


Meets WWC group 
design standards 
without reservations 


896 students, 
most first-year, 
low-income 
(Pell grant 
eligible), and 
in need of 
developmental 
education 


Large sample 


3 City 
University 
of New York 
(CUNY) 
community 
college 
campuses 


Multiple 
settings 


Accelerated Study in 


Associate Programs 
(ASAP): The ASAP 


intervention is a 3-year 
program that provides 
wraparound supports to 
students. 


Relevant features include 
a full-time enrollment 
requirement; an ASAP 
advisor; support from 

an ASAP career and 
employment services staff 
member; ASAP dedicated 
tutoring services; course 
enrollment support, 
including an option for 

an ASAP study success 
seminar; and financial 
support in the form of 
tuition waivers, free public 
transportation, and free 
textbooks. 


Business- 
as-usual: 
Comparison 
group students 
had access to 
business-as- 
usual courses 
and services 
including 
academic 
advisors, 
career services, 
and tutoring 
sessions. 


They were not 
required to be 
enrolled full- 
time. 


Progressing in 
college: 
g = 0.34* 


Academic 
achievement: 
g = 0.23* 


Postsecondary 
degree attainment: 
g = 0.28* 
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Outcome Domain 
and WWC 
Calculated Effect 
Size 


Scrivener et al. 3,835 students 4 City CUNY Start: CUNY Start §Business-as- Progressing in 
(2018) University — for students assessed usual: college: 
Large sample of New York as needing remediation. | Comparison g = -0.74* 
RCT (CUNY) The program’s goal is group students 
Meets WWC group community _ to prepare students for had access to 
' college college-level courses business-as- 
design standards : ae ‘ 
WHRGIE RE SenChOnS campuses — while providing all of the usual services. 
developmental education 
Multiple they need in one semester. They could 
settings CUNY Start’s math receive standard 
instructional approach is developmental 
student-centered, rather °F college-level 
than lecture-centered, courses and 
and integrates both Services. 
reading and writing to 
allow students to move 
more quickly through 
their developmental 
requirements. 
Relevant features include 
intensive developmental 
coursework (pre- 
matriculation) following a 
prescribed approach in 
math, reading, and writing; 
advising and tutoring; 
and a weekly college 
skills seminar. 
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Outcome Domain 
and WWC 
Calculated Effect 


Sundy (2017) 
QED 


Meets WWC group 
design standards 


with reservations 


Participants? 
140 students, 
most first- 
generation and 
low-income 
(Pell grant 
eligible) 


Small sample 


1 community 
college in 
Kentucky 


Single 
setting 


atcsia<-vanice)amexeyareliice) aka 


Student Support 
Services (SSS): The 


SSS intervention is a 
comprehensive program 
that offers academic 
and personal support to 
students. 


Relevant features include 
developmental classes, 
supplemental instruction, 
tutoring, access to 
mathematics and writing 
specialists, career 
planning, course and 
major selection supported 
by individual advising 
sessions, academic 
progress monitoring, 
transfer planning, campus 
visits to 4-year colleges, 
workshops, newsletters, 
social events, and cultural 
enrichment activities. 


(oxeyareliiceyal 


Business- 
as-usual: 
Comparison 
group students 
had access to 
business-as- 
usual services, 
including 

the college’s 
Academic 
Support Center. 


Size 
Academic 
achievement: 
g = -0.42* 


@ A study with a small sample includes fewer than 350 participants. A study with a large sample includes 350 or more 


participants. 


> Unless otherwise indicated, listed features of the intervention condition were not present in the comparison condition. 


* = statistically significant at the .05 level. 
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Recommendation 2: Transform advising to focus on the development 
of sustained, personalized relationships with individual students 
throughout their college career. 


Rationale for Recommendation 2 Level of Evidence: Strong 


WWC staff and the expert panel assigned Recommendation 2 a strong level of evidence, based on 

10 studies of interventions that involve sustained, personalized advising relationships. Seven of the 
studies’ meet WWC group design standards without reservations, and the other three studies'®** meet 
WWC group design standards with reservations. 


Across the 10 studies, there were findings in three outcome domains (Table C.5) even though all 

five outcome domains were relevant for this recommendation. All three domains had statistically 
significant, positive meta-analytic effect sizes: progressing in college (g = 0.30, p < .01), academic 

achievement (g = 0.19, p < .01), and postsecondary degree attainment (g = 0.29, p < .01). 


Table C.5. Domain-level effect sizes across the 10 studies supporting Recommendation 2 


Number Mean bob Oxo) ay ice l=Vaver=) 
Domain of studies effect size Talk=y ave: | p Value 
Progressing in college | 9 | 0.30. 0.28, 0.33 | < 0.01 
Academic achievement | 6 0.19 0.15, 0.23 < 0.01 
Postsecondary degree attainment 5 0.29 | 0.24, 0.34 < 0.01 


Note: Significant findings are bolded. ns = nonsignificant findings. All effect sizes were calculated using a fixed effects meta- 
analytic effect size across studies. 


Evidence from the 10 studies provides a direct test of the recommendation, as all interventions involve 
sustained, personalized advising relationships. In Bettinger & Baker (2014), students were paired 
with a coach who communicated with students via phone, email, text messages, or social networking 
sites to help students prioritize their studies, plan for academic success, identify and overcome 
barriers to academic success, assess students’ lives outside of school, and address specific issues 
highlighted from an algorithm that tracked student performance in their courses. In Binder et al. 
(2015), intervention students were assigned to one advisor for the duration of the program, and they 
were given priority to meet with their assigned advisor. In Hodara et al. (2017), the intervention is 
a comprehensive scholarship and advising program that focuses on building trust between advisors 
and students during the transition from high school to college; provides one-on-one, individualized 
advising that accompanies the establishment of a personal relationship with the student; social and 
emotional support; assistance with financial aid; and scaffolded advising and mentoring aimed at 
enabling and encouraging students’ confidence in independently accessing resources. In Maton et 
al. (2000), the program includes continual personal advising that spans years with highly accessible 
program staff. In Mayer et al. (2019), the advising program is enhanced through technology to 
better support advisees and includes advice about career goals and challenges in school; it provides 
early warning signs of challenges to advisors to intervene as needed, offer guidance, and refer 
students to tutoring and other support services. In Miller et al. (2020), the program includes 
holistic comprehensive advising with small caseloads that provides students with support services 
and academic support to address barriers to student success. In Nosaka & Novak (2014), students 
work with program-specific advisors, mentors, coordinators, and faculty who connect students to 
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opportunities and campus resources, coordinate program activities, teach a seminar, and provide 
feedback on student performance. In Patel & Valenzuela (2013), advisors are assigned to students 
to provide support throughout all program semesters; they act as a consistent support system for 
students, providing guidance for academic success, intervening if a student is falling behind, and 
developing meaningful relationships with students to facilitate both academic and non-academic 
support. In Scrivener & Weiss (2009), students are assigned to a dedicated counselor with a small 
caseload and required to meet frequently to discuss and monitor academic progress and help resolve 
any issues acting as barriers to success. In Scrivener et al. (2015), dedicated program advisors with 
low student-to-advisor ratios are assigned to students and meet frequently. 


The collection of studies demonstrates a medium to large extent of evidence and consistent positive 
effects. In all of the studies supporting this recommendation, advising relationships are sustained 
and personalized. Therefore, the expert panel has assigned a strong level of evidence to this 
recommendation. This rating is supported by the strength of the evidence according to the 
following criteria: 


¢ Extent of Evidence. Each outcome domain average is based on more than one study with a total 
sample size above 350. 


¢ Consistency of Effects on Relevant Outcomes. The average effect sizes for all three of the 
outcome domains (progressing in college, academic achievement, and postsecondary degree 
attainment) are positive and statistically significant and are predominantly derived from studies that 
meet WWC group design standards without reservations. 


¢ Relationship between the Evidence and Recommendation. In all of the studies used to support 
Recommendation 2, advising relationships are sustained and personalized. 
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Table C.6. Studies providing evidence for Recommendation 2: Transform advising to focus on the 
development of sustained, personalized relationships with individual students throughout their 


college career 


=AVA(e(=Yavex-W co) am n<-Xexe) nal pat-vacetclate) amy4 


Comparison 


OlU i Kero) pay-m Bleyart-lin) 
and WWC 
Calculated Effect 


Bettinger & Baker 
(2014) 


Cluster RCT 


Meets WWC group 
design standards 
without reservations 


Participants? 


13,555 
students 


Large sample 


8 universities 
including 

two- and 4- 
year schools, 
public, private 
not-for- 

profit, and 
proprietary 
colleges 


Multiple 
settings 


TalecYavccvalice)amexeyarel tare) aby 


InsideTrack Coach: 
Students in the 
intervention condition 
were paired to a trained 
InsideTrack coach over 
two semesters, who 
worked to help students 
prioritize their studies, 
plan for academic 
success, identify and 
overcome barriers to 
academic success, and 
assess students’ lives 
outside of school. Each 
coach communicated 
with his or her students 
via phone, email, text 
messages, or social 
networking sites. In 
addition to regular 
contacts, coaches 
sometimes had access to 
course information and 
student performance in 
their specific courses, 
which contributed to 

an algorithm that direct 
coaches to specific 
issues that need to be 
addressed and when. 


foxeyateliaceyal 


Business- 
as-usual: 
Comparison 
group students 
had access to 
business-as- 
usual support 
services at their 
universities and 
did not receive 
individualized 
coaching. 


Size 
Progressing in 
college: 

g = 0.13* 


Postsecondary 
degree attainment: 
g = 0.11* 
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Outcome Domain 
and WWC 
Calculated Effect 
Size 


Binder et al. (2015) 
RCT 


Meets WWC group 
design standards 
without reservations 


1,081 students 


Large sample 


1 public 
university in 
New Mexico 


Single setting 


Vision Inspired 
Scholarship through 
Academic Achievement 
(VISTA): The VISTA 
scholarship program 
provided students with 
up to $4,000 over four 
semesters. Scholarship 
payments were tied to 
academic milestones 
including credit hours, 
GPA, and meeting with 
an advisor. 


Relevant to this 
recommendation, VISTA 
students were assigned 
to one advisor for the 
duration of the program, 
and they were given 
priority to meet with 
their assigned advisor. 
With more consistent 
and frequent meetings, 
advisors were more 
likely to get to know 
their VISTA advisees 
and provide referrals for 
non-academic aspects of 
their advisees’ lives. 


Business- 
as-usual: 
Comparison 
group students 
had access to 
business-as- 
usual financial 
aid and other 
services. 

This included 
the potential 

to receive 

the state’s 
scholarship, 
which paid 
tuition at any 
public college 

in the state, as 
long as students 
maintained a 2.5 
cumulative GPA 
and earned at 
least 12 credit 
hours in each 
prior semester. 


The majority of 
students in the 
study sample 
received the 
state scholarship 
during the same 
time that VISTA 
was offered. 


Comparison 
group students 
could request to 
see a particular 
advisor, but 
they typically 
saw whichever 
advisor was 
available. 


Progressing in 
college: 
g = 0.33* 


Postsecondary 
degree attainment: 
g=0.12 
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Participants? Tal e-Yav(-aricolamereyavelitCola bam exeyareli ated] Size 
Hodara et al. (2017) 1,163 first-year 1 community Future Connect: Business- Progressing in 
students college in Future Connect is as-usual: college: 
QED Oregon a comprehensive Comparison g = 0.80* 
Large sample scholarship and roup students 
Meets WWC group Ps a Single setting advising neces for a nee to Academic 
a terns it first-generation and business-as- Benhievemant 
low-income students usual courses g = 0.38 
entering their first year of and services. 
community college. Detailed Eaeeecondany . 
: F degree attainment: 
information on * * 
Relevant features the comparison 9 ~ 0.36 
include building trust condition was 
with the students during — ot included in 
the transition from the study. 
high school to college, 
providing one-on-one, 
individualized advising 
that accompanies the 
establishment of a 
personal relationship 
with the student, early 
support, social and 
emotional support, 
assistance with financial 
aid, and scaffolded 
advising and mentoring 
aimed at enabling 
and encouraging 
students’ confidence in 
independently accessing 
resources. 
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Maton et al. (2000) 
QED 


Meets WWC group 
design standards with 
reservations 


155 Science, 
Engineering, 
and 
Mathematics 
(SEM) students 


Small sample 


1 public 
university in 
Maryland 


Single setting 


Meyerhoff Scholars 
Program: The program 

is designed to 

increase the number 

of underrepresented 
minority group members 
who pursue graduate 
and professional degrees 
in science, engineering, 
and math. 


Features include financial 
aid, a summer bridge 
program, community- 
building activities, shared 
residence hall, personal 
advising, counseling, 
mentorship, and tutoring, 
and community service. 


Relevant to this 
recommendation, 
advisors work with 
students for years 

after connecting at the 
Summer Bridge program. 
Program staff are highly 
accessible and involved 
in student life. Contact 
between program 
students and staff is 
continual and includes 
large “family” meetings. 


Business-as- 
usual: 
Comparison 
group students 
had access to 
business-as- 
usual services. 
They are in 
the same SEM 
courses as the 
intervention 


group students. 


Academic 
achievement: 
g =0.42 
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Mayer et al. (2019) 
RCT 


Meets WWC 
standards without 
reservations 


Participants? 
8,011 students 


Large sample 


1 public 
university in 
California, 

1 public 
university 

in North 
Carolina, and 
1 community 
college in 
Pennsylvania 


Multiple 
settings 


Enhanced Integrated 


Planning and Advising 
for Student Success 


(iPASS): iPASS uses 
technology to enhance 
the quantity of advising 
that students receive 
in college. Relevant 
features include advice 
about career goals and 
challenges in school; 
provides early warning 
signs of challenges to 
advisors to intervene as 
needed. 


Enhanced iPASS 
provides a toolbox for 
advisors to follow up 
with students as they 
progress, offer guidance, 
and refer students 

to tutoring and other 
support services. The 
enhanced version also 
improved on an early 
alert system with more 
precise data and earlier 
flagging of students in 
their first semester. 


The program required 
students to meet 

with advisors at least 
once. One of the three 
sites included a peer 
mentoring component. 


Each of the three 
institutions implemented 
iPASS slightly differently. 


Unenhanced 
iPASS: 
Comparison 
group students 
participated in 
“unenhanced 
iPASS’ in 
which they also 
received early 
alerts and more 
advising. 


The 
“unenhanced” 
iPASS program 
was less well 
integrated, 

not applied as 
consistently, and 
included fewer 
components. 


Progressing in 
college: 
g = 0.02 


Academic 
achievement: 
g = 0.01 
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Miller et al. (2020) 
RCT 


Meets WWC group 
design standards 
without reservations 


1,501 low- 
income 
students (Pell 
grant eligible) 


Large sample 


3 community 
colleges in 
Ohio 


Multiple 
settings 


Accelerated Study in 
Associate Programs 
(ASAP): The Ohio 
Programs model was 
designed to closely 
follow the CUNY ASAP 
model to address 
multiple potential barriers 
to students completing 
community college within 
3 years. 


The comprehensive 
model consists of the 
following features: 
comprehensive 
advising, tutoring, 
financial support, course 
enrollment support, 
full-time enrollment 
requirement, and holistic 
support from program 
staff. 


Relevant to this 
recommendation, 
program advisors 

have smaller, more 
manageable caseloads 
and provide students 
with support services 
and academic support 
to address barriers to 
student success. 


Business-as- 
usual: 
Comparison 
group students 
had access to 
business-as- 
usual services 
that were less 
intensive and 
individualized 
than those which 
the intervention 
group received. 


Progressing in 
college: 
g = 0.34* 


Postsecondary 
degree attainment: 
g = 0.49* 
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Nosaka & Novak 
(2014) 


QED 
Meets WWC group 


design standards with 


3,982 first-year 
students 


Large sample 


1 public 
university in 
Colorado 


Single setting 


Key Communities: 
Students are clustered 
in residential learning 
communities that aim 

to foster a sense of 
community, academics, 
leadership, diversity, and 


Business- 
as-usual: 
Comparison 
group students 
did not 
participate in the 
program and 


Progressing in 
college: 
g = 0.22* 


reservations ; 

service. had access to 
business-as- 

Relevant to this usual courses 
recommendation, and services. 
designated advisors Detailed 
work with small clusters information on 
of students and students — the comparison 
work with undergraduate condition was 
Key mentors who not included in 
are supervised and the study. 
supported by Key 
coordinators and Key 
seminar faculty. 
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Patel & Valenzuela 
(2013) 


RCT 


Meets WWC group 
design standards 
without reservations 


1,028 male 
Hispanic 
students, most 
low-income 
(Pell grant 
eligible) 


Large sample 


1 community 
college in 
Arizona 


Single setting 


Adelante Scholarship 


Program: The 
Adelante program is 


a performance-based 
scholarship program in 
which students receive 
scholarships and other 
support contingent upon 
academic progress and 
achievement in college. 
Features of the program 
include an orientation, 
advising, tutoring, 
academic workshops, 
and learning activities. 


Relevant to this 
recommendation, 
beginning in the first 
semester, students are 
assigned an advisor 

to provide support 
throughout all three 
program semesters. This 
dedicated advisor acts 
as a consistent support 
system for students as 
they navigate various 
college systems, 
provides guidance for 
academic success, and 
intervenes if a student is 
falling behind. 


This dependable 
connection with an 
advisor allows for 

the development of a 
meaningful relationship 
between student and 
advisor that facilitates 
non-academic support 
and discussions around 
health, work, and 
family life. 


Business- 
as-usual: 
Comparison 
group students 
had access to 
business-as- 
usual services 


and financial aid. 


Progressing in 
college: 
g =0.17* 


Academic 
achievement: 
g = -0.05 
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Outcome Domain 
and WWC 
Calculated Effect 
Size 


Scrivener & Weiss 
(2009) 


RCT 


Meets WWC group 
design standards 
without reservations 


2,139 students 


Large sample 


2 community 
colleges in 
Ohio 


Multiple 
settings 


Opening Doors: 
Features of the Opening 


Doors program included 
assignment to a 
dedicated counselor 
with a small caseload, 

a scholarship, study 
groups, social events, 
tutoring, and an 
orientation course. 


Relevant to this 
recommendation, 
students met with their 
counselor frequently 

to discuss and monitor 
academic progress and 
help resolve any issues 
acting as a barrier 

to success. 


Stipends were contingent 


on these meetings 
with counselors as 
well as enrollment 
and maintaining good 
academic standing. 


Business- 
as-usual: 
Comparison 
group students 
had access 

to business- 
as-usual 
counseling. 


The ratio of 
students to 
available 
counselors 
across the 
colleges for the 
comparison 
group was 
1,000:1, about 
12 times the 
ratio for the 
first community 
college 
intervention 
group and 6 
times the ratio 
for the second 
community 
college 
intervention 
group. 


Progressing in 
college: 
g = 0.09* 


Academic 
achievement: 
g = 0.08 
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Outcome Domain 
and WWC 
Calculated Effect 
Size 


Scrivener et al. 
(2015) 


RCT 


Meets WWC group 
design standards 
without reservations 


896 students, 
most first-year, 
low-income 
(Pell grant 
eligible), and 
in need of 
developmental 
education 


Large sample 


3 City 
University 
of New York 
(CUNY) 
community 
college 
campuses 


Multiple 
settings 


Accelerated Study in 


Associate Programs 
(ASAP): The ASAP 


intervention is a 3-year 
program that provides 
wraparound supports 

to students. Features 
include a full-time 
enrollment requirement; 
an ASAP advisor; 
support from an ASAP 
career and employment 
services staff member; 
ASAP dedicated 
tutoring services; course 
enrollment support, 
including an option for 
an ASAP study success 
seminar; and financial 
support in the form of 
tuition waivers, free 
public transportation, and 
free textbooks. 


Relevant to this 
recommendation, 
ASAP has low student- 
to-advisor ratios and 
students meet with their 
advisor frequently. The 
ASAP advisors solely 
serve ASAP students. 


Business- 
as-usual: 
Comparison 
group students 
had access to 
business-as- 
usual courses 
and services 
including 
academic 
advisors, 
career services, 
and tutoring 
sessions. 
They were 

not required 

to be enrolled 
full-time. 


Progressing in 
college: 
g = 0.34* 


Academic 
achievement: 
g = 0.23* 


Postsecondary 
degree attainment: 
g = 0.28* 


participants. 


* = statistically significant at the .05 level. 


@ A study with a small sample includes fewer than 350 participants. A study with a large sample includes 350 or more 


> Unless otherwise indicated, listed features of the intervention condition were not present in the comparison condition. 
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Recommendation 3: Use mentoring and coaching to enhance 
comprehensive, integrated advising in ways that support students’ 
achievement and progression. 


Rationale for Recommendation 3 Level of Evidence: Strong 


WWC staff and the expert panel assigned Recommendation 3 a strong level of evidence, based on 
12 studies of interventions that include mentoring. Eight of the studies'** meet WWC group design 
standards without reservations, and the other four studies'* meet WWC group design standards 
with reservations. 


Across the 12 studies, there were findings in three outcome domains (Table C.7) even though all 
five outcome domains were relevant for this recommendation. All three domains had statistically 
significant, positive meta-analytic effect sizes: progressing in college (g = 0.14, p < .01), academic 
achievement (g = 0.10, p < .01), and postsecondary degree attainment (g = 0.11, p < .05). 


Table C.7. Domain-level effect sizes across the 12 studies supporting Recommendation 3 


Number Mean Tob Oxo) ani(e(-Valer=) 
Domain of studies effect size Talk ave-| p Value 
Progressing in college | 7 | 0.14 | 0.11, 0.18 | < 0.01 
Academic achievement | 8 0.10 0.05, 0.15. <0.01 
Postsecondary degree attainment 1 0.11 | 0.00, 0.22 < 0.05 


Note: Significant findings are bolded. ns = nonsignificant findings. All effect sizes were calculated using a fixed effects 
meta-analytic effect size across studies, except for the postsecondary degree attainment domain. This domain had findings from 
just one study; the effect size and p-value presented here are the domain-level average effect size and p-value for the individual 
relevant study. 


Evidence from the 12 studies provides a direct test of the recommendation, as mentoring or coaching 
is a primary component of the intervention in eight studies and is a secondary component of the 
intervention in four studies. In Bettinger & Baker (2014), students were paired with a coach who 
communicated with students via phone, email, text messages, or social networking to help students 
prioritize their studies, plan for academic success, identify and overcome barriers to academic success, 
assess students’ lives outside of school, and address specific issues highlighted from an algorithm 

that tracked student course performance. In Campbell & Campbell (2007), program participants 
were matched with volunteer faculty mentors for 1 year based on their shared academic interests and 
were also offered several workshops through the mentoring office. In Dennehy & Dasgupta (2017), 
participants were paired with a female or male peer mentor who was an advanced engineering student 
and met in person for at least an hour about once a month over the course of the academic year. In 
Kim et al. (2013), students were mentored by graduate-level registered nurses at the same university 
either in person or through telephone calls, emails, text messages, or Facebook interactions that 
aimed at providing emotional support and helping socialize the mentees into the nursing profession. 
In Lavallais (2017), students had access to individual 1.5-hour monthly coaching sessions that covered 
topics including academic and personal growth, internship/career readiness, campus engagement, 
counsel on personal matters, and assistance with any life challenges hindering the student’s focus. 

In Maton et al. (2000), science and engineering students were paired with mentors who are 
professionals in a science, engineering, or mathematics occupation. In Mayer et al. (2019), one of 
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the three sites of the program involved peer mentoring as part of a technology-enhanced advising 
model. In Medina (2016), as part of a pre-college enrollment program, students met one-on-one 

with their peer mentor for 20-30 minutes at least once a week during the 5-week program. In Nosaka 
& Novak (2014), students participating in a learning community had access to peer mentoring. In 
Oreopoulos & Petronijevic (2018), one of the two intervention groups involves pairing students with 
an upper-year undergraduate student who serves as their personal coach and is available via phone, 
online, or in person to answer questions and to discuss campus services, selecting a major, academic 
coursework, getting jobs on campus, their feelings (nervousness, anxiety, sadness), and how to book 
appointments with counselors. In Servies (1999), students were assigned peer mentors to meet with 
once a week throughout a semester in which the sessions covered topics ranging from orientation 

to campus, how to schedule classes, and career research that accompanied joint activities such as 
attending a social event on campus, lunch, movies/games on campus, jointly meeting with faculty and 
staff members, introducing students to a club or organization, and helping to arrange tutoring sessions 
when needed. In Thomas (2005), the intervention was an ethnic-based mentoring model over the 
course of the academic year in which junior and senior students who identified as Black spent an hour 
once a week mentoring incoming first-year students who also identified as Black. 


The collection of studies demonstrates a medium to large extent of evidence and consistent positive 
effects. In a preponderance of the studies supporting this recommendation, mentoring or coaching is a 
major component of the tested intervention. Therefore, the expert panel has assigned a strong level of 
evidence to this recommendation. This rating is supported by the strength of the evidence according 
to the following criteria: 


¢ Extent of Evidence. Two of the three outcome domain averages are based on more than one study 
with a total sample size above 350. 


¢ Consistency of Effects on Relevant Outcomes. The average effect sizes for all three of the 
outcome domains (progressing in college, academic achievement, and postsecondary degree 
attainment) are positive and statistically significant and are predominantly derived from studies 
that meet WWC group design standards without reservations. 


¢ Relationship between the Evidence and Recommendation. In eight of the 12 studies 
used to support Recommendation 3, mentoring or coaching is a major component of the 
tested intervention. 
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Table C.8. Studies providing evidence for Recommendation 3: Use mentoring and coaching to enhance 
comprehensive, integrated advising in ways that support students’ achievement and progression 
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Comparison 
Condition 


Outcome Domain 
and WWC 
Calculated Effect 
Size 


Bettinger & Baker 
(2014) 


Cluster RCT 


Meets WWC 
group design 
standards without 
reservations 


Participants? 
13,555 students 


Large sample 


8 universities 
including 2- 
and 4-year 
schools, 
public, private 
not-for-profit, 
and proprietary 
colleges 


Multiple 
settings 


InsideTrack coach: 
Students in the 
intervention condition 
were paired to a trained 
InsideTrack coach over 
two semesters who 
worked to help students 
prioritize their studies, 
plan for academic 
success, identify and 
overcome barriers to 
academic success, and 
assess their lives outside 
of school. 


Each coach 
communicated with his or 
her students via phone, 
email, text messages, or 
social networking sites. 


In addition to regular 
contacts, coaches 
sometimes had access to 
course information and 
student performance in 
their specific courses, 
which contributed to an 
algorithm that directs 
coaches to specific 
issues that need to be 
addressed and when. 


Business-as- 
usual: 
Comparison 
group students 
had access to 
business-as- 
usual support 
services at their 
universities and 
did not receive 
individualized 
coaching. 


Progressing in 
college: 
g = 0.13* 


Postsecondary 
degree attainment: 
g =0.11* 
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Comparison 
Condition 
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Outcome Domain 
and WWC 
Calculated Effect 
Size 


Campbell & 
Campbell (2007) 


QED 


Meets WWC group 
design standards 
with reservations 


678 transfer 

or incoming 
first-year students 
(53% transfer 
students; 

47% incoming 
first-year) 


Target population 
was students 
from racial/ 
ethnic groups 
underrepresented 
at the university 
(primarily 
Hispanic/Latino 
and Black/African 
American) 


Large sample 


1 university in 
California 


Single setting 


Faculty Mentoring 
Program: For 1 year, 
participants were 
matched with volunteer 
faculty mentors after 
classes began, based on 
their shared academic 
interests. Mentors were 
asked to meet with their 
students a minimum of 
three times during the 
semester, including an 
initial meeting to discuss 
goals and expectations. 
Each mentor was 
allowed up to $150 per 
year for incidentals for 
each student mentored 
and an associated 

small grant program to 
support research-related 
activities. 


A mentoring office 
sponsored several 
workshops (with catered 
meals) for the mentors 
and their students, and 
numerous small tokens 
of recognition were 
distributed (coffee mugs, 
pens, etc.). 


Business- 
as-usual: 
Comparison 
group students 
had access to 
business-as- 
usual services 
at the university 
and did not 
receive faculty 
mentoring 
through the 
program. 


Academic 
achievement: 
g =0.12 
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Outcome Domain 
and WWC 
Calculated Effect 
Size 


Dennehy & 
Dasgupta (2017) 


RCT 


Meets WWC 
group design 
standards without 
reservations 


150 female 
college students 
entering an 
engineering 
major were 
randomized to 

a female peer 
mentor (52), male 
peer mentor (51) 
or no mentor (47) 


Small sample 


1 public 4-year 
university in 
Massachusetts 


Single setting 


Peer Mentoring Program: 
Participants were paired 


with a female or male 
peer mentor who was an 
advanced engineering 
student. Participants 

and their mentors met 

in person for at least an 
hour about once a month 
over the course of the 
academic year. 


Mentors were matched 
with one to three 
students and kept track 
of their interactions using 
monthly online surveys. 
Mentors were all junior 
or seniors and had 
declared majors in one 
of the four engineering 
departments. 


Business- 
as-usual: 
Comparison 
group students 
had access to 
business-as- 
usual services at 
the university in 
which students 
did not have a 
peer mentor. 


Academic 
achievement: 
g = 0.02 
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Kim et al. (2013) 
RCT 


Meets WWC 
group design 
standards without 
reservations 


Participants? 


76 nursing 
students 


Small sample 


1 private 4 
year university 
in California 


Single setting 


Taic-iac-varece)amezeyateliace) aba 


Mentoring Program: 
The students assigned 


to the experimental 
group received up to 
20 hours of mentoring 
by registered nurses 
who were in a graduate 
nursing program at 

the same university as 
well as e-mentoring. 
E-mentoring included 
telephone calls, emails, 
text messages, or 
Facebook interactions. 


The mentors were 
instructed to provide 
emotional support, help 
socialize mentees into 
the nursing profession, 
and serve as role 
models. They were 

not allowed to do any 
tutoring or help with class 
assignments. 


The mentoring program 
included a 2-hour 
mentorship training 
session. 


loxeyateliiceyal 


Business- 
as-usual: 
Comparison 
group students 
did not receive 
mentoring. 


Size 
Academic 
achievement: 
g=0.41 
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Lavallais (2017) 
RCT 


Meets WWC 
group design 
standards without 
reservations 


100 at-risk 
students (all male 
and self-identified 
as Black/African 
American) 


Small sample 


1 public 4-year 
university in 
Tennessee 


Single setting 


Mentoring & Coaching: 
Program offered 


individual coaching 
sessions in extension of 
three 2-hour workshops. 
The three workshops 
were offered for students 
in both the intervention 
and comparison group. 
The workshops followed 
The Perception of 
Achievement Curriculum, 
focusing on academic 
challenges, academic 
goal-setting, university 
engagement and campus 
involvement, study 
habits, and internship/ 
career exposure 
opportunities. 


In extension, intervention 
group students were 
offered individual 
1.5-hour monthly 
coaching sessions for 
the remainder of the 
academic year. The 
coaching sessions 
covered a broad range 
of topics, including 
academic and personal 
growth, internship/career 
readiness, campus 
engagement, counsel on 
personal matters, and 
assistance with any life 
challenges hindering the 
student's focus. 


Business-as- 
usual: 
Comparison 
group students 
participated in 
the workshops 
and had access 
to business- 

as usual 
student support 
services but 
did not receive 
the monthly 
coaching 
sessions. 


Academic 
achievement: 
g = 0.84* 
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and WWC 
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Maton et al. (2000) 
QED 


Meets WWC group 
design standards 
with reservations 


155 Science, 
Engineering, and 
Mathematics 
(SEM) students 


Small sample 


1 public 
university in 
Maryland 


Single setting 


Meyerhoff Scholars 
Program: The program 

is designed to 

increase the number 

of underrepresented 
minority group members 
who pursue graduate 
and professional degrees 
in science, engineering, 
and math. 


Relevant features 
include financial aid, a 
summer bridge program, 
community-building 
activities, personal 
advising, counseling, and 
mentorship, tutoring, and 
community service. 


Relevant to this 
recommendation, the 
mentors each student 
is paired with are 
professionals ina SEM 
occupation. 


Business-as- 
usual: 
Comparison 
group students 
had access to 
business-as- 
usual services. 
They are in 
the same SEM 
courses as the 
intervention 


group students. 


Academic 
achievement: 
g =0.42 
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and WWC 
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Size 


Mayer et al. (2019) 
RCT 


Meets WWC 
group design 
standards without 
reservations 


Participants? 
8,011 students 


Large sample 


1 public 
university in 
California, 

1 public 
university 

in North 
Carolina, and 
1 community 
college in 
Pennsylvania 


Multiple 
settings 


Enhanced Integrated 


Planning and Advising 
for Student Success 


(iPASS): Enhanced 
iPASS provides a toolbox 
for advisors to follow up 
with students as they 
progress, offer guidance, 
and refer students 

to tutoring and other 
support services. The 
enhanced version also 
improved on an early 
alert system with more 
precise data and earlier 
flagging of students in 
their first semester. 


The program required 
students to meet with 
advisors at least once. 
Each of the three 
institutions implemented 
iPASS slightly differently. 


Relevant to this 
recommendation, one of 
the three sites included 
a peer mentoring 
component. 


Unenhanced 
iPASS: 
Comparison 
group students 
participated in 
“unenhanced 
iPASS’ in 
which they also 
received early 
alerts and more 
advising. 


The 
“unenhanced” 
iPASS program 
was less well 
integrated, 

not applied as 
consistently, and 
included fewer 
components. 


Progressing in 
college: 
g = 0.02 


Academic 
achievement: 
g = 0.01 
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Medina (2016) 
QED 


Meets WWC group 
design standards 
with reservations 


7,770 first-year 
students 


Large sample 


1 public 
university 

in the 
southeastern 
United States 


Single setting 


Summer Bridge 
Program: The summer 


bridge program (SBP) 

is a 5-week pre-college 
enrollment program 
designed to help first- 
year students transition 
from high school to 
college. Students live on 
campus and participate 
in interactive events and 
up to 8 credit hours of 
academic coursework. 
SBP includes an 
orientation session, peer 
mentoring, wellness 
activities, tutoring, career 
counseling, and physical 
and mental health 
services. 


Relevant to this 
recommendation, 
students meet one-on- 
one with their mentor for 
20-30 minutes at least 
once a week during the 
program. 


Business-as- 
usual: 
Comparison 
group students 
had access to 
business-as- 
usual courses 
and services. 


The comparison 
group chose not 
to participate 

in the SBP and 
were matched to 
the intervention 
group on 
demographics, 
academic 
preparation, 
financial 

aid, college 
academics, and 
college interests 
and intentions. 


Progressing in 
college: 
g = 0.13* 
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Nosaka & Novak 
(2014) 


QED 


Meets WWC group 
design standards 
with reservations 


3,982 first-year 
students 


Large sample 


1 public 
university in 
Colorado 


Single setting 


Key Communities: 
Students participate in a 
Key learning community 
that aims to foster a 
sense of community, 
academics, leadership, 
diversity, and service. 


Features include a 2-day 
summer orientation, 
integrated courses and 

a Key seminar, peer 
mentoring, early alert 
system for grade and 
performance feedback, 

a shared residence hall, 
and community-building 
event. 


Relevant to this 
recommendation, the 
program also included 
peer mentoring. 


Business-as- 
usual: 
Comparison 
group students 
did not 
participate in the 
program and 
had access to 
business-as- 
usual courses 
and services. 
Detailed 
information on 
the comparison 
condition was 
not included in 
the study. 


Progressing in 
college: 
g = 0.22* 
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Oreopoulos & 
Petronijevic 
(2018) 


RCT 


Meets WWC 
group design 


standards without 


reservations 


Participants? 


2,990 first-year 
students 


Large sample 


=AYA(e(=Yavex-W co) am nc-Xexe) tal patzyace relate) aed 


1 university 
(3 campuses) 
in Ontario, 
Canada 


Multiple 
settings 


Tat=iac-vaneceyamezeyareliace) aba 


There were two 
interventions 
implemented in the study. 
They shared the same 
core component, which 
was an online, 2.5-hour 
goal-setting exercise that 
students completed in 
the first 2 weeks of the 
first semester. 


(1) Online Goal- 


Setting and Coaching: 
Students were assigned 


to an upper-year 
undergraduate student 
who served as their 
personal coach and was 
available to meet with 
students to answer any 
questions (via phone, 
online, or in person). 
Coaches sent students 
regular text and email 
messages of advice, 
encouragement, and 
motivation. 


Topics discussed in 
their meetings included 
location of campus 
services, how to select 
a major, questions 
about their academic 
coursework, getting jobs 
on campus, their feelings 
(nervousness, anxiety, 
sadness) and how to 
book appointments with 
counselors. 


Comparison 
Condition 


Online Goal- 
Setting Only: 
Like students 

in both 
interventions, 
comparison 
group students 
completed the 
online goal- 
setting exercise. 


Throughout 
the rest of 

the academic 
year, students 
had access to 
business-as- 
usual services 
and resources. 


Appendix C 


Outcome Domain 
and WWC 
Calculated Effect 
Size 

Progressing in 
college: 

g = 0.15* 


Academic 
achievement: 
g = 0.12* 
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Oreopoulos & 
Petronijevic 


(2018) (continued) 


RCT 


Meets WWC 
group design 


standards without 


reservations 


Participants? 


2,990 first-year 
students 


Large sample 


=AYA(e(=Yavex-W co) am nc-Xexe) tal patzyace relate) aed 


1 university 
(3 campuses) 
in Ontario, 
Canada 


Multiple 
settings 


Tatcsiavc-vareceyamezeyareliace) aka 


(2) Online Goal-Setting 


and Text Messaging: 
Students were assigned 


to receive email and 
text messages ata 
frequency that they 
choose (once a week, 
2-3 times per week, or 3 
or more times per week). 
They all received email 
messages, but if they 
provided their phone 
number, they received 
both email and text 
messages (the same 
messages). 


Messages were 

focused on academic 
and study preparation 
advice, information on 
university resources, 

and motivation and 
encouragement. The aim 
of these messages was 
to provide “nudges” to 
students. 


The messages 

allowed for two-way 
communication, 

and students were 
encouraged either to 
respond to messages 

or to initiate contact with 
their coach about a topic 
of their choice. 


Comparison 
Condition 
Online Goal- 
Setting Only: 
Like students 
in both 
interventions, 
comparison 
group students 
completed the 
online goal- 
setting exercise. 


Throughout 
the rest of 

the academic 
year, students 
had access to 
business-as- 
usual services 
and resources. 


Appendix C 


Outcome Domain 
and WWC 
Calculated Effect 
Size 

Progressing in 
college: 

g = 0.15* 


Academic 
achievement: 
g = 0.12* 


WWC 2022003 


Effective Advising for Postsecondary Students | Appendix C | 99 


Participants? 


AYA (oY avex-W co) am nc-Xexe) nal narzyarerclate) aed 


Tatc=iavc-varece)amezeyateliace) aka 


Comparison 
Condition 


Appendix C 


Outcome Domain 
and WWC 
Calculated Effect 
Size 


Servies (1999) 
RCT 


Meets WWC 
group design 
standards without 
reservations 


60 low-income 
(Perkins grant 
eligible) 2-year 
technology 
majors 


Small sample 


1 public 
university in 
Indiana 


Single setting 


Mentoring Program: 
Students were assigned 


peer mentors who were 
academically successful 
upper-level students at 
the college. Students met 
with their mentor once 

a week throughout the 
semester, starting before 
the first day of class. 
The initial conversation 
oriented them to campus 
and their scheduled 
classes. 


Each meeting afterwards 
included one of a large 
number of suggested 
activities: introducing 
the students to a 

club or organization, 
attending a social event 
on campus, other joint 
social activities including 
lunch, movies/games on 
campus or exercising 
together, looking into 
career testing and 
career research, having 
lunch together, studying 
together, or jointly 
meeting with faculty 

and staff members. In 
addition to the 1 hour of 
required mentoring, the 
mentor/tutors were to 
conduct or arrange for 
tutoring sessions 

when needed. 


Business-as- 
usual: 
Comparison 
group students 
experienced 
business-as- 
usual services 
and had access 
to the various 
supports offered 
by the university 
but did not have 
direction or 
guidance from 
upper-level 
peers to use 
these supports. 


Progressing in 
college: 
g = 0.00 
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Outcome Domain 
and WWC 
Calculated Effect 


Thomas (2005) 
RCT 


Meets WWC 
group design 
standards without 
reservations 


Participants? 


980 first-year 
Black students 


Small sample 


1 public 
university in 
Michigan 


Single setting 


Tatc=ia<-vaniceyamezeyateliace) aba 
African American 


Student Mentorin 
Program (AASMP): The 


intervention was an 
ethnic-based mentoring 
model, developed and 
run by students at the 
university. Juniors and 
seniors who identified as 
Black mentored incoming 
first-year students who 
also identified as Black. 
Mentors met with their 
mentees once a week 
for an hour over the 
academic year. Mentors 
were assigned two or 
three mentees each. 


Mentors also participated 
in a year-long training 
program and small group 
supervision meetings 
that met for 2 hours 
every other week over 
the year. Supervision 
allowed mentors to 
discuss their experiences 
and receive guidance 
and troubleshooting 

as needed. 


loxeyateliiceyal 


Phone or email 
check-ins: 
Comparison 
group members 
were contacted 
once every 3 
weeks by phone 
or email. They 
were asked how 
they were doing 
in college, but 
were not actively 
mentored. 


Comparison 
group members 
were offered a 
mentor for the 
final month of 
their first year. 


Size 
Progressing in 
college: 

g = -0.03 


Academic 
achievement: 
g =0.12 


@ A study with a small sample includes fewer than 350 participants. A study with a /arge sample includes 350 or more participants. 


> Unless otherwise indicated, listed features of the intervention condition were not present in the comparison condition. 


* = statistically significant at the .05 level. 
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Recommendation 4: Embed positive incentives in intentionally 
designed advising structures to encourage student participation and 
continued engagement. 


Rationale for Recommendation 4 Level of Evidence: Strong 


WWC staff and the expert panel assigned Recommendation 4 a strong level of evidence, based on six 
studies of interventions that include embedded incentives. All six studies'** meet WWC group design 
standards without reservations. 


Across the six studies, there were findings in three outcome domains (Table C.9) even though all 
five outcome domains were relevant for this recommendation. All three domains had statistically 
significant, positive meta-analytic effect sizes: progressing in college (g = 0.23, p < .01), academic 
achievement (g = 0.13, p < .01), and postsecondary degree attainment (g = 0.32, p< .O1). 


Table C.9. Domain-level effect sizes across the six studies supporting Recommendation 4 


Number Mean Tob Oxo) nile (-aler=) 
Domain of studies effect size Talked ave-1| p Value 
Progressing in college 6 0.23 | 0.19, 0.28 < 0.01 
Academic achievement 4 0.13 | 0.07, 0.18 < 0.01 
Postsecondary degree attainment 3 0.32 | 0.25, 0.39 < 0.01 


Note: Significant findings are bolded. ns = nonsignificant findings. All effect sizes were calculated using a fixed effects meta- 
analytic effect size across studies. 


Evidence from the six studies provides a direct test of the recommendation, as incentives are a 
primary component of the intervention in four studies and are a secondary component of the 
intervention in two studies. In Binder et al. (2015), the scholarship program issued payments 

tied to academic milestones including credit hours, GPA, and mandatory advising. In Brock & 
Richburg-Hayes (2006), students were assigned counselors with smaller caseloads who monitored 
their academic performance and disbursed scholarships contingent on enrollment and academic 
standing. In Miller et al. (2020), program students were eligible to receive a $50 incentive every 
month contingent on participation in advising, tutoring, and career services. In Patel & Valenzuela 
(2013), the intervention is a performance-based scholarship program in which students receive 
scholarships and other support contingent upon academic progress and achievement in college. In 
Scrivener & Weiss (2009), scholarship stipends were contingent on enrollment, maintaining good 
academic standing, and meetings with a dedicated counselor who monitors academic progress and 
helps resolve any issues acting as a barrier to success. In Scrivener et al. (2015), as part of a program 
that provides wraparound supports to students, attendance at advising appointments was linked to 
students’ receipt of monthly MetroCards (public transit passes). 
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The collection of studies demonstrates a medium to large extent of evidence and consistent positive 
effects. In a preponderance of the studies supporting this recommendation, incentives are a major 
component of the tested intervention. Therefore, the expert panel has assigned a strong level of 
evidence to this recommendation. This rating is supported by the strength of the evidence according 
to the following criteria: 


¢ Extent of Evidence. Each outcome domain average is based on more than one study with a total 
sample size above 350. 


¢ Consistency of Effects on Relevant Outcomes. The average effect sizes for all three of the 
outcome domains (progressing in college, academic achievement, and postsecondary degree 
attainment) are positive and statistically significant and are predominantly derived from studies that 
meet WWC group design standards without reservations. 


¢ Relationship between the Evidence and Recommendation. In four of the six studies used to 
support Recommendation 4, incentives are a major component of the tested intervention. 


Table C.10. Studies providing evidence for Recommendation 4: Embed positive incentives in intentionally 
designed advising structures to encourage student participation and continued engagement 


Participants? 


=AY/ (eo (-Yalex-W co) mmac-Xeroypalantcvalerclice) ane. 


TalecYavccvalico)amexeyarel tare) aby 


Comparison 
loxeyaTelitCeya! 


Outcome Domain 
and WWC 
Calculated Effect 
Size 


Binder et al. (2015) 
RCT 


Meets WWC group 
design standards 
without reservations 


1,081 students 


Large sample 


1 public 
university in 
New Mexico 


Single 
setting 


Vision Inspired 
Scholarship through 
Academic Achievement 
(VISTA): The VISTA 
scholarship program 
provided students with 
up to $4,000 over four 
semesters. Scholarship 
payments were tied to 
academic milestones 
including credit hours, 
GPA, and meeting with 
an advisor. 


Advising was mandatory 
and part of the model 
that theorized that 
enhanced advising 
combined with financial 
aid and incentives to 
take more course credits 
and increase credit 
accumulation would 
improve student progress 
toward earning a timely 
degree. 


Business-as-usual: 
The comparison 
group had access 
to business-as- 
usual financial aid 
and other services. 
This included 

the potential to 
receive the state’s 
scholarship, which 
paid tuition at any 
public college in the 
state, as long as 
students maintained 
a 2.5 cumulative 
GPA and earned 

at least 12 credit 
hours in each prior 
semester. The 
majority of students 
in the study sample 
received the state 
scholarship during 
the same time that 
VISTA was offered. 


Progressing in 
college: 
g = 0.33* 


Postsecondary 
degree attainment: 
g=0.12 
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Brock & Richburg- 
Hayes (2006) 


RCT 


Meets WWC group 
design standards 
without reservations 


1,019 
students, 
majority live 
in household 
receiving 
government 
benefits 


Large sample 


2 community 
colleges in 
Louisiana 


Multiple 
settings 


Opening Doors: 

Opening Doors (OD) 
students were assigned 
counselors with 

smaller caseloads who 
monitored their academic 
performance and 
disbursed scholarships 
contingent on enrollment 
and academic standing. 


For summer sessions, 
payments were divided 
into two $250 payments. 
Importantly, students 
could enroll for a second 
semester and receive 

a second $1000, for a 
maximum of $2000 and 
could take a break from 
school and still be eligible 
to get the scholarship 

if they returned and 
enrolled at least half- 
time. In addition to 
monitoring students’ 
performance, counselors 
were supposed to 

help students resolve 
problems that impinged 
on their academic 
performance. 


In order to maintain 
eligibility for the 
scholarship, students had 
to enroll at least half-time 
(6+ credits), for which 
they received $250, earn 
at least a C average by 
mid-term (another $250), 
pass their courses, and 
maintain a GPA of at 
least 2.0 to receive the 
final $500. 


Business-as-usual: 
The comparison 
group had access to 
business-as-usual 
services, including 
access to regular 
counselors with a 
higher caseload. 


Progressing in 
college: 
g = 0.23 


Academic 
achievement: 
g=0.31 
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Miller et al. (2020) 
RCT 


Meets WWC group 
design standards 
without reservations 


1,501 low- 
income 
students (Pell 
grant eligible) 


Large sample 


3 community 
colleges in 
Ohio 


Multiple 
settings 


Accelerated Study in 
Associate Programs 
(ASAP): The Ohio 
Programs model was 
designed to closely 
follow the CUNY ASAP 
model to address 
multiple potential barriers 
to students completing 
community college 
within 3 years. The 
comprehensive model 
consists of the following 
features: comprehensive 
advising, tutoring, 
financial support, course 
enrollment support, 
full-time enrollment 
requirement, and 
holistic support from 
program staff. 


Relevant to this 
recommendation, ASAP 
students were eligible to 
receive a $50 incentive 
every month contingent 
on participation in 
advising, tutoring, and 
career services. Other 
encouragements for 
participation included 
requirements, “sticks” 
(removal of financial 
support, holds on 
registration), and 
messaging. 


Business-as- 
usual: Comparison 
group students 
had access to 
business-as-usual 
services that were 
less intensive and 
individualized than 
those which the 
intervention group 
received. 


Progressing in 
college: 
g = 0.34* 


Postsecondary 
degree attainment: 
g = 0.49* 
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and WWC 
Calculated Effect 
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Patel & Valenzuela 
(2013) 


RCT 


Meets WWC group 
design standards 
without reservations 


1,028 male 
Hispanic 
students, 
majority 
low-income 
(Pell grant 
eligible) 


Large sample 


1 community 
college in 
Arizona 


Single 
setting 


Adelante Scholarship 


Program: The 
Adelante program is 


a performance-based 
scholarship program in 
which students receive 
scholarships and other 
support contingent upon 
academic progress and 
achievement in college. 
Program students were 
eligible for awards up 

to $1,500 per semester 
for three semesters. 
Features of the program 
include an orientation, 
advising, tutoring, 
academic workshops, 
and learning activities. 


Business-as-usual: 
Comparison group 
students had 
access to business- 
as-usual services 
and financial aid. 


Progressing in 
college: 
g =0.17* 


Academic 
achievement: 
g =-0.05 


Scrivener & Weiss 


2,139 students 


2 community 


Opening Doors: Features 


Business-as-usual: 


Progressing in 


(2009) colleges in — of the Opening Doors The comparison college: 
Large sample Ohio program included group had access to g = 0.09* 

RCT ; assignment to a business-as-usual 

Mecis WWE croup Monie dedicated counselor counseling. eeeaiie - 

Cece EHEEE gs with a small caseload, asta =. re om: 

without reservations pea badenlaie ious sania aa 
groups, social events, students to 
tutoring, and an available 
orientation course. counselors across 
the colleges for the 

Students met with their | comparison group 
counselor frequently was 1000:1, about 
to discuss and monitor 12 times the ratio 
academic progress and _ for one community 
help resolve any issues __ college intervention 
acting as a barrier to group and 6 times 
success. Relevant to the ratio compared 
this recommendation, to the second 
stipends were contingent community college 
on these meetings intervention group. 
with counselors as 
well as enrollment 
and maintaining good 
academic standing. 
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Calculated Effect 
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Scrivener et al. 
(2015) 


RCT 


Meets WWC group 
design standards 
without reservations 


896 students, 
majority first- 
year, low- 
income (Pell 
grant eligible), 
and in need of 
developmental 
education 


Large sample 


3 City 
University 
of New York 
(CUNY) 
community 
college 
campuses 


Multiple 
settings 


Accelerated Study in 


Associate Programs 
(ASAP): The ASAP 


intervention is a 3-year 
program that provides 
wraparound supports 

to students. Features of 
ASAP include a full-time 
enrollment requirement; 
an ASAP advisor; 
support from an ASAP 
career and employment 
services staff member; 
ASAP dedicated 
tutoring services; course 
enrollment support, 
including an option for 
an ASAP study success 
seminar; and financial 
support in the form of 
tuition waivers, free 
public transportation, and 
free textbooks. 


Relevant to this 
recommendation, 
attendance at advising 
appointments was linked 
to students’ receipt of 
monthly MetroCards 
(public transit passes). 
Requirements and 
messaging encouraged 
the desired behaviors in 
the program. 


Business-as-usual: 
The comparison 
group had access 
to business-as- 
usual courses and 
services including 
academic advisors, 
career services, and 
tutoring sessions. 


Comparison 
students were also 
not required to be 
enrolled full-time. 


Progressing in 
college: 
g = 0.34* 


Academic 
achievement: 
g = 0.23* 


Postsecondary 
degree attainment: 
g = 0.28* 


* = statistically significant at the .05 level. 


a A study with a small sample includes fewer than 350 participants. A study with a large sample includes 350 or more participants. 
> Unless otherwise indicated, listed features of the intervention condition were not present in the comparison condition. 
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guide). 


45 See https://employees.crc.losrios.edu/guided-pathways/student-success-teams (this source was 
not included in the meta-analyses for this practice guide). 


46 Visher (2016, p. 7) (this source was not included in the meta-analyses for this practice guide). 

4” Nosaka & Novak (2014); Miller et al. (2020); Scrivener et al. (2015); Scrivener et al. (2018). 
48 Weiss et al. (2011) (this source was not included in the meta-analyses for this practice guide). 

49 Hodara et al. (2017); Patel & Valenzuela (2013). 


°° Bettinger & Baker (2014); Binder et al. (2015); Hodara et al. (2017); Maton et al. (2000); Miller 
et al. (2020); Nosaka & Novak (2014); Patel & Valenzuela (2013); Scrivener et al. (2015). 


>For more information on the core principles of the evidence-based framework for sustained, 
strategic, intrusive, personalized, and proactive (SSIPP) advising, see Community College Research 
Center (2013); Klempin et al. (2019); and Achieving the Dream (2018) (these sources were not 
included in the meta-analyses for this practice guide). 


>2 Bailey et al. (2016, p. 21) (this source was not included in the meta-analyses for this practice guide). 


°3 Community College Research Center (2017) (this source was not included in the meta-analyses for 
this practice guide). 


°4 For example, see the Highlights from the Field “Promoting Efficient Individualized Advising 
Through the Use of Technology: Enhanced iPASS” in this chapter. 


° Bettinger & Baker (2014); Binder et al. (2015); Mayer et al. (2019); Miller et al. (2020); Patel & 
Valenzuela (2013); Scrivener & Weiss (2009); Scrivener et al. (2015). 


56 Hodara et al. (2017); Maton et al. (2000); Nosaka & Novak (2014). 

°’ Bettinger & Baker (2014); Binder et al. (2015); Miller et al. (2020); Scrivener et al. (2015). 

58 Maton et al. (2000); Scrivener et al. (2015); Patel & Valenzuela (2013). 

°° Bloom & McLellan (2016) (this source was not included in the meta-analyses for this practice guide). 
6° For additional information, see https://www.appreciativeadvising.net/resources.html. 


61 Maton et al. (2000). 
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62 Scrivener et al. (2015). 

63 Patel & Valenzuela (2013). 
64 Scrivener et al. (2015). 

6 Scrivener & Weiss (2009). 
66 Miller et al. (2020). 


67 Since the conclusion of the study and broad expansion of the program since 2015, the CUNY ASAP 
student-advisor ratio increased to 150:1 while continuing to realize similar outcomes. See Miller et 
al. (2020). 


68 Scrivener et al. (2015). 

6° Scrivener et al. (2015). 

70Visher et al. (2012) (this source was not included in the meta-analyses for this practice guide). 

71 Maton et al. (2000). 

” Miller et al. (2020); Scrivener et al. (2018). 

3 Bailey et al. (2016, p. 21) (this source was not included in the meta-analyses for this practice guide). 


™ See the exhibit produced by the Ada Center and the Aspen Institute (n.d.) that depicts how higher 
education leaders can make decisions regarding how to invest in technology that supports student 
success (this source was not included in the meta-analyses for this practice guide). 


* Bettinger & Baker (2014); Brock & Richburg-Hayes (2006); Mayer et al. (2019); Scrivener et 
al. (2015). 


76 See What Works Clearinghouse (2019) for an intervention report on InsideTrack, https://ies.ed.gov/ 
ncee/wwc/InterventionReport/696 (this source was not included in the meta-analyses for this 
practice guide). 


” Bettinger & Baker (2014). 

78 Scrivener & Weiss (2009). 

79 Mayer et al. (2019). 

8°Mayer et al. (2019). 

5! Maton et al. (2000). 

82 Plante & Bata (2016) (this source was not included in the meta-analyses for this practice guide). 
83 Scrivener et al. (2015). 

84 Powell et al. (2013) (this source was not included in the meta-analyses for this practice guide). 


85 Patel & Valenzuela (2013, pp. 26-27). 
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86 Boykin & Prince (2015); Strumbos et al. (2018) (these sources were not included in the meta-analyses 
for this practice guide). 


87 Miller et al. (2020, p. 21). 


88 For more on flipped advising, see Steele (2016) (this source was not included in the meta-analyses for 
this practice guide). 


8° The words in italics correspond to a revised version of Bloom’s taxonomy, which focuses on 
cognitive aspects of learning (see Bloom & McLellan, 2016) (this source was not included in the meta- 
analyses for this practice guide). For more on this taxonomy, see Anderson & Krathwohl (2001) (this 
source was not included in the meta-analyses for this practice guide). 


°° Campbell & Campbell (2007); Lavallais (2017); Maton et al., (2000). 

* Kim et al. (2013); Dennehy & Dasgupta (2017); Thomas (2005). 

° Maton et al. (2000). 

% Kim et al. (2013); Medina (2016); Nosaka & Novak (2014); Thomas (2005). 
* Bettinger & Baker (2014). 


* Bettinger & Baker (2014); Dennehy & Dasgupta (2017); Kim et al. (2013); Lavallais (2017); 
Mayer et al. (2019); Oreopoulos & Petronijevic (2018); Servies (1999); Thomas (2005). 


°° Campbell & Campbell (2007); Maton et al. (2000); Medina (2016); Nosaka & Novak (2014). 
*7 Dennehy & Dasgupta (2017); Kim et al. (2013); Thomas (2005). 
°8 Medina (2016). 

°° Nosaka & Novak, 2014. 

100 Thomas (2005). 

‘1 Campbell & Campbell (2007); Maton et al. (2000). 

' Bettinger & Baker (2014). 

103 Kim et al. (2013); Dennehy & Dasgupta (2017); Thomas (2005). 
104 Kim et al. (2013). 

65 Dennehy & Dasgupta (2017). 

6 Dennehy & Dasgupta (2017); Thomas (2005). 

‘07 Campbell & Campbell (2007). 

'08 Maton et al. (2000). 

9 Bettinger & Baker (2014). 


40 Bettinger & Baker (2014); Dennehy & Dasgupta (2017); Maton et al. (2000); Servies (1999). 
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1! Dennehy & Dasgupta (2017); Servies (1999); Maton et al. (2000); Medina (2016); Thomas 
(2005). 


Bettinger & Baker (2014); Kim et al. (2013); Mayer et al. (2019); Oreopoulos & Petronijevic 
(2018). 


3 Kim et al. (2013); Medina (2016); Servies (1999). 


"4 Campbell & Campbell (2007); Dennehy & Dasgupta (2017); Oreopoulos & Petronijevic (2018); 
Thomas (2005). 


"5 Dennehy & Dasgupta (2017); Kim et al. (2013); Oreopoulos & Petronijevic (2018); Servies 
(1999); Thomas (2005). 


"6 Kim et al. (2013, p. 45). 

"7 Servies (1999). 

“8 Thomas (2005). 

"9 Thomas (2005). 

20 Kim et al. (2013). 

11 Thomas (2005). 

22 Medina (2016). 

3 Campbell & Campbell (2007). 
24 Thomas (2015). 

25 Maton et al. (2000). 

6 Dennehy & Dasgupta (2017). 
"7 Nosaka & Novak (2014). 

88 Bailey et al. (2016) (this source was not included in the meta-analyses for this practice guide). 


”9 Binder et al. (2015); Brock & Richburg-Hayes (2006); Miller et al. (2020); Patel & Valenzuela 
(2013); Scrivener et al. (2015); Scrivener & Weiss (2009). 


‘0 Binder et al. (2015); Brock & Richburg-Hayes (2006); Miller et al. (2020); Patel & Valenzuela 
(2013); Scrivener & Weiss (2009); Scrivener et al. (2015). 


531 Scrivener et al. (2015); Strumbos et al. (2018) (this source was not included in the meta-analyses for 
this practice guide). 


‘82 Bailey et al. (2016); Kalamkarian & Karp (2015) (these sources were not included in the meta-analyses 
for this practice guide). 


83 Scrivener & Weiss (2009). 
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84 Patel & Valenzuela (2013). 
5 Nosaka & Novak (2014). 
86 Patel & Valenzuela (2013). 
87 Nosaka & Novak (2014). 


'88 Schreiner & Anderson (2005) (this source was not included in the meta-analyses for this 
practice guide). 


'89 Soria et al. (2017) (this source was not included in the meta-analyses for this practice guide). 


40 Binder et al. (2015); Miller et al. (2020); Patel & Valenzuela (2013); Visher et al. (2012) (this 
source was not included in the meta-analyses for this practice guide); Weiss et al. (2014) (this source 
was not included in the meta-analyses for this practice guide). 


41 Miller et al. (2020). 


42 Visher et al. (2012); Weiss et al. (2014) (these sources were not included in the meta-analyses for this 
practice guide). 


43 Patel & Valenzuela (2013). 

44 Binder et al. (2015). 

45 Mares (2016) (this source was not included in the meta-analyses for this practice guide). 
46 Brock & Richburg-Hayes (2006). 


47 Studies were reviewed using the WWC Version 4.0 Standards Handbook, available at 
https://ies.ed.gov/ncee/wwc/Handbooks, and the version 4.0 practice guide review protocol 
available at https://ies.ed.gov/ncee/wwc/Document/1293. 


48 Following WWC guidelines, improved outcomes are indicated by a positive, statistically significant 
effect from a meta-analytic effect size calculated separately for each relevant outcome domain. For 
more information on how the WWC calculates these effect sizes and determines levels of evidence, 
see the WWC Version 4.1 Procedures Handbook at https://ies.ed.gov/ncee/wwc/Handbooks. 


49 Outcome domains relevant to the scope of the practice guide are defined by the protocol used for 
the systematic review. 


‘50 Key outcome domains are those that are most relevant to each specific recommendation. 


‘5! Tf the finding in the relevant outcome domain is from only a single study, then the effect size from 
that study takes the place of the mean effect from a fixed-effects meta-analysis. 


‘52 American Educational Research Association, American Psychological Association, & National 
Council on Measurement in Education (1999). 


‘53 https://ies.ed.gov/ncee/wwc/Document/1293 
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‘54 The updated What Works Clearinghouse Standards and Procedures Handbook, Version 4.1 was 
publicly available at the time of release of this practice guide. However, the reviews of studies 
that contributed to this practice guide’s recommendations were conducted prior to that update. 
Therefore, the reviews for this practice guide were conducted under Version 4.0. Levels of evidence 
were assessed using a fixed-effects meta-analysis, following guidance in Version 4.1, however. 


‘55 WWC practice guides aim to summarize the entire evidence base for a recommendation, so they do 
not exclude studies with non-significant findings. Small studies with non-significant positive findings 
can contribute to a statistically significant positive mean meta-analytic effect size. See appendix C 
for more detail on the fixed-effects meta-analysis approach used by the WWC. 


‘56 The 16 studies not relevant to the recommendations tested interventions such as student success 
courses that did not generate evidence of positive impacts. Because practice guides focus on 
recommendations backed by at least some evidence of positive impacts, the panel did not rely on 
these studies to generate a recommendation. The study reviews for the 16 studies can be viewed 
on the individual studies page of the What Works Clearinghouse website. These study reviews are 
hyperlinked in the References list. 


‘57 The WWC chose the fixed-effects model because its goal is to make inferences about the studies in 
WWC intervention reports and practice guides. Unlike the fixed-effect (singular) model, the fixed- 
effects (plural) model does not assume that the studies are estimating a common effect. Instead, the 
fixed-effects model assumes that the observed variation among the effect sizes in the meta-analysis 
reflects the true variation in population effects. Accordingly, inferences to larger study populations 
are constrained to those that share the same patterns of important study characteristics that are 
related to effect size. See Hedges and Vevea’s (1998) What Works Clearinghouse Standards and 
Procedures Handbook, Version 4.1. 


The WWC carefully weighed the various options for meta-analysis, including using random effects 
estimation. We determined that the fixed-effects modeling approach is currently the best option 

for the WWC, based on the available research. Implementing a random effects model requires 
estimating the between-studies variance component, and this estimate is poor unless the meta- 
analysis includes a relatively large number of studies. The fixed-effects approach allows the WWC to 
conceptually acknowledge variability in effects. As of January 2020, the largest synthesis conducted 
by the WWC was based on nine studies, and most WWC intervention reports are far smaller: two or 
three studies is typical. Therefore, we believe that for the foreseeable future, it is not practical for 
the WWC to adopt a random effects model for its syntheses. https://ies.ed.gov/ncee/wwc/Docs/ 
referenceresources/SumResponsePublicComments-v4-1-508.pdf. 


‘58 Tf multiple contrasts from a study are entered into a meta-analysis, participants from experimental 
conditions that are common across contrasts will be counted twice, resulting in effect sizes that 
are statistically dependent. This dependence in a meta-analysis can create a serious threat to the 
validity of the results. 


‘9 For the postsecondary degree attainment outcome domain, we prioritized the outcomes measured 
at the longest follow-up time point reported. For cumulative outcomes in the progressing in college 
domain such as credit accumulation, we prioritized outcomes that began closest to the end of the 
intervention and extended to the longest follow-up time point. For more detail, see page 9 of the 
practice guide review protocol (https://ies.ed.gov/ncee/wwc/Document/1293). 
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‘60 Miller et al. (2020); Patel & Valenzuela (2013); Scrivener et al. (2015); Scrivener et al. (2018). 
‘6! Hodara et al. (2017); Maton et al. (2000); Nosaka & Novak (2014); Sundy (2017). 


‘62 Bettinger & Baker (2014); Binder et al. (2015); Mayer et al. (2019); Miller et al. (2020); Patel & 
Valenzuela (2013); Scrivener & Weiss (2009); Scrivener et al. (2015). 


‘63 Hodara et al. (2017); Maton et al. (2000); Nosaka & Novak (2014). 


‘64 Bettinger & Baker (2014); Dennehy & Dasgupta (2017); Kim et al. (2013); Lavallais (2017); 
Mayer et al. (2019); Oreopoulos & Petronijevic (2018); Servies (1999); Thomas (2005). 


‘65 Campbell & Campbell (2007); Maton et al. (2000); Medina (2016); Nosaka & Novak (2014). 


‘66 Binder et al. (2015); Brock & Richburg-Hayes (2006); Miller et al. (2020); Patel & Valenzuela 
(2013); Scrivener & Weiss (2009); Scrivener et al. (2015). 
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